0 


AD-A285  038 


.*1.  •  ■’r*- 

**■# 


■"■"DTia 

ELECTS 

^StP  2  9  'W* 

\  ■■»;4':"-,^;r  -wLi! 


'V 

r  ■'"^  '.. 


'  '^'-Cf  ■  - 


:  '‘•i*j-‘x-»('.''W'"'^*  -^. 


i  AN  ASSESSMENT  OF  FORECASTING  METHODS: 
^  ^  COOPERATIVE  LOGISTICS  SUPPLY  SUPPORT 
-  y|  ARRANGEMENT  (CLSS A)  INVESTMENT  ITEMS 

1 

THESIS 


Jeffrey  S.  Grafton,  B.  A.  Earl  W.  Sollmann,  B.  S. 
GS-12  GS-12 

AFIT/GLMA-AU94S-20 


This  docuxDtat  bos  b*#o  approrsd 
§ot  public  tsUos*  oad  tola;  ils 
diitzibuhon  is  unlisaiwd  ' 


DEPARTMENT  OFJHE  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Wright-Patterson  Air  Force  Base,  Ohio 


AFnVGLM/LAL/94S-20 


O 


AN  ASSESSMENT  OF  FORECASTING  METHODS: 
COOPERATIVE  LOGISTICS  SUPPLY  SUPPORT 
ARRANGEMENT  (CLSSA)  INVESTMENT  ITEMS 


THESIS 

Jeffrey  S.  Grafton,  B.  A.  Eail  W.  SoUmann,  B.  S. 
GS-12  GS-12 


AFn7GLM/LAU94S-20 


Approved  for  public  release;  distribution  unlimited 

jmC  QUALITY  INSPECTED  3 


Accesion  For 


NTIS  CRA&I 
OTIC  TAB 
Unannounced 
Justification 


By _ 

Distribution  / 


Availability  Codes 


AFIT/GLM/LAL/94S-20 


AN  ASSESSMENT  OF  FORECASTING  METHODS: 
COOPERATIVE  LOGISTICS  SUPPLY  SUPPORT 
ARRANGEMENT  (CLSSA)  INVESTMENT  ITEMS 

THESIS 


Presented  to  the  Faculty  of  the  School  of  Logistics  and  Acquisition  Management 
of  the  Air  Force  Institute  of  Technology 
Air  University 
in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of 
Masters  of  Science  in  Logistics  Management 


JeflErey  S.  Grafton,  B.  A. 
GS-12 


Eail  W.  SoUmann,  B.S. 
GS-12 


September  1994 


Approved  for  public  release;  distribution  unlimited 


Acknowledgments 


We  wish  to  thank  several  members  of  the  Air  Fare  Security  Assistance  Center 
(AFSAC)  for  their  suppot  in  accomplishing  this  research.  Mr.  Roger  Reynolds, 
AFSAC/CA,  served  as  our  thesis  sponsor  and  proposed  CLSSA  foecasting  as  a  research 
topic.  Mr.  Chuck  LaVelle,  AFSAC/XMXA,  shared  his  in  depth  knowledge  of  the  current 
CLSSA  program  and  kept  us  infomed  of  proposed  CLSSA  policy  changes.  Mr.  Edward 
Hater,  AFSAC/ITTS,  gready  assisted  our  research  by  extracting  data  from  the  Security 
Assistance  Management  System,  explaining  the  AFSAC  retention  formula  algorithm,  and 
producing  sample  forecasts  using  the  AFSAC  retention  formula  method. 

We  appreciate  the  support  of  our  thesis  advisors.  Major  Karen  Currie  and  Or. 
Craig  Brandt,  throughout  this  effot.  Their  insights,  critiques  and  suggestions  greatly 
enhanced  our  thesis.  Their  prompt  reviews  of  the  drafts  were  especially  appreciated. 

Finally,  we  wish  to  thank  our  families,  Monica,  Leslie  and  Kristen  Sollmann  and 
Lisa,  Rebekah,  Joshua  and  Elizabeth  Grafton,  for  their  patience  and  support  Without 
their  support,  this  thesis  would  not  have  been  possible. 

Jeffrey  S.  Grafton 
Earl  W.  Sollmann 


ii 


The  views  expressed  in  this  thesis  are  those  of  the  authors 
and  do  not  reflect  the  official  policy  or  position  of  the 
Department  of  Defense  or  the  U.S.  Government. 


Table  of  Contents 

Page 

Acknowledgments . ii 

List  of  figures . vi 

List  of  Tables . x 

Abstract . xi 

1.  Introduction . 1 

General  Issue . 1 

Background . 4 

FMSO I  Development  and  Modification . 7 

Renegotiation  (financial  Update) . 8 

Current  Method . 10 

Specific  Problem . 11 

Investigative  Questions . 12 

Scope  and  Limitations . 12 

n.  Literature  Review . 14 

Introduction . 14 

Background . 14 

Research  Purpose . 15 

Legislative  Environment . 15 

Need  for  Forecasting . 16 

USAF  Reparable  Forecasting  Methods . 17 

Forecasting  Dilemma. . 18 

Forecasting  Methodologies . 19 

Selected  Forecasting  Methods . 24 

Summary . 25 


U1 


Page 


ni.  Methodology . 26 

Qiapter  Overview . 26 

Controlling  Population  of  Interest . 26 

Sample  Selection . 27 

Model  Selection . 30 

Forecasting  Methods  Evaluated . 31 

Demand  Segmentation . 34 

Forecasting  Process . 35 

Forecasting  Software . 37 

One  Quarter  into  the  Future . 38 

Twenty-four  Month  Forecasts . 39 

Thirty-six  Month  Forecasts . 41 

ffine  Month  Faecasts . 41 

Perfoitnance  Measurements . 42 

Cost  Measurements . 43 

Validity . 44 

Study  Limitations . 45 

IV.  Results  and  Analysis . 46 

Overview . 46 

One  Quarter  into  the  Future  Forecast . 46 

Limitations  to  the  One  Quarter  Forecast . 48 

Forecasting  for  One  Lead  Time . 49 

Radonale  for  Revised  Methodology . 52 

Accuracy  Measurement . 53 

Twenty-four  Month  Forecast . 54 

Thirty-six  Month  Forecast . 57 


iv 


Page 

Nine  Month  Forecast . 60 

Forecast  Error  Distribution . 61 

Analysis  of  Results . 63 

Demand  Analysis . 72 

Summary  of  Results . 73 

V.  Conclusitms  and  Recommendations . . . 77 

Ccmclusions . 77 

Recommendations . 78 

Summary . 79 

Appendix  A:  NSN  Listing . : . 82 

Appendix  B:  Data  Patterns . 89 

Appendix  C:  Data  Inputs . 123 

Appendix  D:  Data  Outputs . 128 

Appendix  E:  Financial  Comparison . 141 

Bibliography . 145 

Vita . 147 


V 


List  of  Figures 

Hgure  Page 

1 .  Yearly  Percentage  of  Programmed  Requisitions . 3 

2.  Histogram  of  Sample  Population . 30 

3.  Demand  Pattern  for  Item  HI . . . 90 

4.  Demand  Pattern  for  Item  H2 . 90 

5.  Demand  Pattern  for  Item  H3 . 91 

6.  Demand  Pattern  for  Item  H4 . 91 

7.  Demand  Pattern  for  Item  H5 . 92 

8.  Demand  Pattern  for  Item  H6 . 92 

9.  Demand  Panem  for  Item  H7 . 93 

10.  Demand  Pattern  for  Item  H8 . 93 

1 1 .  Demand  Pattern  for  Item  H9 . . . 94 

12.  Demand  Pattern  for  Item  HIO . 94 

1 3.  Demand  Pattern  for  Item  HI  1 . 95 

14.  Demand  Pattern  for  Item  H12 . 95 

15.  Demand  Pattern  for  Item  HI  3 . 96 

16.  Demand  Pattern  for  Item  Ml . 97 

17.  Demand  Pattern  for  Item  M2 . 97 

18.  Demand  Pattern  for  Item  M3 . 98 

19.  Demand  Pattern  for  Item  M4 . 98 

20.  Demand  Pattern  for  Item  M5 . 99 

21.  Demand  Pattern  for  Item  M6 . 99 

vi 


Page 

22.  Demand  Pattern  for  Item  M7 . 100 

23.  Demand  Pattern  for  Item  M8 . 100 

24.  Demand  Pattern  for  Item  M9 . 101 

25.  Demand  Pattern  for  Item  MIO . 101 

26.  Demand  Pattern  for  Item  Ml  1 . 102 

27.  Demand  Pattern  for  Item  M12 . 102 

28.  Demand  Pattern  for  Item  M13 . 103 

29.  Demand  Pattern  for  Item  M14 . 103 

30.  Demand  Pattern  for  Item  M15 . 104 

3 1 .  Demand  Pattern  for  Item  M 16 . 104 

32.  Demand  Pattern  for  Item  M17 . 105 

33.  Demand  Pattern  for  Item  M18 . 105 

34.  Demand  Pattern  for  Item  M19 . 106 

35.  Demand  Pattern  for  Item  M20 . 106 

36.  Demand  Pattern  for  Item  M21 . 107 

37.  Demand  Pattern  for  Item  M22 . 107 

38.  Demand  Pattern  for  Item  M23 . 108 

39.  Demand  Pattern  for  Item  M24 . 108 

40.  Demand  Pattern  for  Item  M25 . 109 

41.  Demand  Pattern  for  Item  M26 . 109 

42.  Demand  Pattern  for  Item  M27 . 1 10 

43.  Demand  Pattern  for  Item  M28 . 1 10 

VU 


Page 

44.  Demand  Pattern  for  Item  M29 . 1 1 1 

45.  Demand  Pattern  for  Item  M30 . 1 1 1 

46.  Demand  Pattern  for  It^m  M31 . 1 12 

47.  Demand  Pattern  for  Item  M32 . 1 12 

48.  Demand  Pattern  for  Item  M33 . 113 

49.  Demand  Pattern  for  Item  M34 . 113 

50.  Demand  Pattern  for  Item  M35 . 1 14 

51.  Demand  Pattern  for  Item  M36 . 1 14 

52.  Demand  Pattern  for  Item  M37 . . . 1 15 

53.  Demand  Pattern  for  Item  M38 . 1 15 

54.  Demand  Pattern  for  Item  M39 . 1 16 

55.  Demand  Pattern  for  Item  M40 . 1 16 

56.  Demand  Pattern  for  Item  M41 . 1 17 

57.  Demand  Pattern  for  Item  M42 . . . 1 17 

58.  Demand  Pattern  for  Item  M43 . 1 1 8 

59.  Demand  Pattern  for  Item  M44 . 118 

60.  Demand  Pattern  for  Item  M45 . 1 19 

61.  Demand  Pattern  for  Item  M46 . 119 

62.  Demand  Pattern  for  Item  M47 . 120 

63.  Demand  Pattern  for  Item  M48 . 120 

64.  Demand  Pattern  for  Item  M49 . 121 

65.  Demand  Pattern  for  Item  M50 . . . 121 


viii 


66.  Demand  Pattern  for  Item  MSI 


Page 

,.122 


IX 


List  of  Tables 

Table  Page 

1.  One  Quarter  Into  the  Future  Forecast . 48 

2.  Comparison  of  Combined  H  &  N  Code  24-  Month  Forecasts . 55 

3.  Comparison  of  Combined  H  &  N  Code  24-Monthe  Forecast . 55 

Excluding  Five  NSNs 

4.  Con:q>arison  of  N-Coded  Only  24-Month  Forecasts . 56 

5.  Con^arison  of  N-Coded  Only  24-Month  Forecasts, . 57 

Excluding  Five  NSNs 

6.  Comparison  of  Combined  H  &  N  Code  36-Month  Forecasts . 57 

7.  Comparison  of  Combined  H  &  N  Code  36-Month  Forecasts, . 58 

Excluding  Five  NSNs 

8.  Con^arison  of  N-Coded  Only  36-Month  Forecasts . 58 

9.  Con^aiison  of  N-Coded  Only  36-Month  Forecasts . 59 

Excluding  Five  NSNs 

10.  Con^aiision  of  H-Coded  Only  9-Month  Forecasts . 60 

1 1.  Comparlsion  of  H-Coded  Only  9-Month  Forecasts, . 61 

Excluding  Hve  NSNs 

12.  Range  of  Error  Comparison  Among  .Ml  Methods . 62 

13.  Error  Comparison  in  Relevant  Categories  Only . 63 

14.  Average  Value,  Analysis  One . 69 

15.  Average  Value  By  Category,  Analysis  Two . 7 1 

16.  Actual  NSN  Price  Comparison,  Analysis  Three . 72 

17.  Percent  of  Dollars  and  NSNs  by  Category . 73 


X 


AFIT/GLM/LAL/94S-20 


ABSTRACT 

The  United  States  (US)  promotes  collective  security  in  the  Free  World  via  the  Foreign 
Military  Sales  (FMS)  program.  FMS  custon^rs  prefer  to  acquire  weapon  system  logistic 
support  through  FMS  rather  than  by  direct  commercial  vendor  support  Ninety-seven  percent 
of  the  follow-on  logistics  requirements  are  submitted  via  a  special  program  called  Cooperative 
Logistics  Supply  Supptnt  Arrangement  (CLSSA).  CLSSA,  while  sound  in  theory,  has  been  a 
poor  performer.  The  USAF  must  modify  the  CLSSA  program  ot  risk  losing  future  FMS  sales 
to  competing  nations.  Modifying  CLSSA  to  utilize  an  automated  forecasting  process  versus 
the  current  manual  process  will  greatly  improve  customer  service.  Efficient  and  timely  logistic 
support  is  a  key  decision  factor  as  friendly  nations  evaluate  the  source  of  their  next  major 
weapon  systems  acquisition.  The  US  as  a  whole  will  gain  from  the  USAFs  new  approach  to 
CLSSA  through  the  political,  military  and  economic  benetits  that  result  from  increased  FMS 
demand  for  US  weapon  systems. 
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AN  ASSESSMENT  OF  FORECASTING  METHODS: 
COOPERATIVE  LOGISTICS  SUPPLY  SUPPORT 
ARRANGEMENT  (CLSSA)  INVESTMENT  ITEMS 


General  Issue 

The  United  States  (US)  promotes  the  principle  of  collective  security  among  the 
nations  of  tfie  Free  World.  The  US  Joint  Chiefs  <rf  Staff  state,  "Collective  security  is  and 
must  continue  to  be  a  vital  objective  of  poUticaL  econtnnic,  social  and  military  interaction 
and  cooperation  between  the  US  and  its  Mends  and  allies"  (19:35).  One  method  the  US 
uses  to  promote  collective  security  is  by  offering  to  sell  its  defense  systems  to  other 
nations  via  the  Foreign  Military  Sales  (FMS)  program.  Government  to  government 
contracts  called  Letters  of  Offer  and  Acceptance,  commonly  referred  to  as  cases,  are  the 
fOTinal  basis  for  all  FMS  sales. 

The  total  cumulative  sales  of  the  Department  of  Defense  (DOD)  FMS  program,  as 
of  August  1993,  were  valued  at  $220.8  billion.  Air  Force  Security  Assistance  Center 
(AFSAQ  is  responsible  for  the  administration  of  $  98.1  billion,  44.4  percent  of  this  DOD 
FMS  total  (22:1).  AFSAC  provides  FMS  logistic  support  to  eligible  countries  and 
international  organizations  through  initial  support  packages  and  through  follow-on 
suppon  cases.  An  initial  weapon  system  sale  consists  of  the  weapon  systems  (C-130, 
F-16,  F-15)  and  the  logistic  support  necessary  (spares,  suppon  equipment,  technical 


assistance,  training,  publications)  to  establish  an  in-countiy  operational  capability.  The 
initial  sales  case  typically  provides  for  logistics  support  just  for  the  initial  operating  phase 
(nOTmally  two  years).  Follow-on  support  cases,  as  the  name  implies,  provide  the 
subsequent  material  and  services  necessary  to  continue  operating  and  maintaining  the 
system  and  equipment  through  its  remaining  service  life. 

Customer  countries  overwhelmingly  i^efer  to  acquire  defense  systems'  follow-on 
logistic  support  through  additional  FMS  cases  rather  than  direct  commercial  support 
(19:337).  At  AFSAC,  ninety-seven  percent  of  these  follow-on  requisitions  are  submitted 
via  a  special  logistics  support  program  called  Cooperative  Logistics  Supply  Suppt^ 
Arrangement  (CLSSA).  The  (XSSA  program  is  designed  to  enhance  timely  follow-on 
spares  and  repair  support  by  providing  a  mecharusm  for  the  FMS  customers  to  participate 
in  the  USAF  supply  system.  To  participate  in  CLSSA,  the  FMS  customer  must  project 
anticipated  future  requirements  and  provide  an  initial  deposit  equal  to  5/17  or  29.4  percent 
of  the  materiel  value  of  their  requirements.  The  USAF  then  places  the  materiel  on-order 
so  that  when  the  FMS  customer  actually  needs  the  materiel,  the  materiel  is  either  already 
on-hand  ready  for  shipment  or  on-order  with  most  of  the  procurement  lead  time  having 
already  transpired. 

Two  types  of  FMS  cases  form  the  basis  of  the  CLSSA  program:  the  Foreign 
Military  Sales  Order  I  (FMSO  I)  and  the  Foreign  Military  Sales  Order  n  (FMSO II).  Each 
FMS  customer  has  a  uiuque  FMSO  I  and  FMSO  II  case  combination.  Each  respective 
customer  identifies  its  requirements  by  National  Stock  Number  (NSN)  and  quantity  on  the 
FMSO  I  case.  These  requirements  are  used  to  calculate  the  iititial  deposit  to  be  collected 
from  each  customer.  The  requirements  for  each  NSN  and  quantity  are  consolidated  by  the 
Security  Assistance  Management  Information  System  (SAMIS)  and  then  forwarded  to  the 
source  of  supply  for  procurement  action.  The  FMSO  11  case  is  used  to  withdraw  items 
frrom  the  DOD  supply  system  at  full  material  value.  Basically,  the  FMSO  I  orders  materiel 


2 


into  the  DOD  inventory  in  anticipation  of  subsequent  FMS  demands,  and  the  FMSO  n 
pulls  the  materiel  from  the  DOD  inventory  and  provides  funds  for  the  procurement  of  a 
replacement  item.  The  AFSAC  managed  FMSO  I  cases  are  collectively  valued  at 
$1,086,275,576,  as  of  7  March  1994,  and  the  FMSO  11  cases  had  an  annual  requisition 
value  of  $715,289,936.  Cumulatively,  the  CLSSA  program  has  an  impact  on  the  DOD 
supply  system  of  $1.8  billion  (2:1). 

The  general  issue  of  this  thesis  concerns  the  FMSO  I  portion  of  the  CLSSA 
program.  The  FMSO  I  does  not  operate  in  an  efficient  manner  for  investment  items. 
Thirty-six  percent  of  all  investment  items  on  the  FMSO  I  case  have  had  no  demands  in  the 
past  four  years  and  fourteen  percent  of  the  items  added  to  the  FMSO  I  in  the  past  four 
years  also  have  had  no  demands  (2:1).  Over  the  past  10  years,  only  about  forty-five 
percent  of  the  investment  item  requisitions  submitted  received  the  benefits  of  preferential 
supply  treatment  offered  by  CLSSA  (see  Figure  1)  (2:1). 


84  85  86  87  88  89  90  91  92  93 


Figure  1.  Yearly  Percentage  of  Programmed  Requisitions  (2:1) 
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This  poor  performance  is  a  clear  indicator  that  the  USAF  needs  to  modify  the 
CLSSA  program  to  ensure  that  it  operates  efficiently  and  provides  quality,  timely  spares 
support  in  response  to  the  foreign  customers'  investment.  If  the  USAF  cannot  provide 
timely  logistic  support  for  its  weapon  systems,  the  use  of  FMS  and  its  associated  reliance 
on  the  personnel  and  material  resources  of  fiiendly  governments  for  augmented  suppon  in 
conflicts  will  diminish.  Loss  of  FMS  sales  would  also  mean  a  loss  in  political,  military,  and 
economic  benefits  for  the  US  as  a  whole.  To  continue  to  share  these  support  costs  with 
the  allies  and  to  maintain  the  US  defense  industrial  base,  the  USAF  must  continue  to 
provide  efficient,  quality  customer  logistic  support 

Background 

Currently,  there  are  fifty  CLSSA  participants  out  of  the  seventy-six  countries  and 
two  international  organizations  that  purchase  follow-tm  logistic  support  from  the  US 
(2: 1).  The  participants  are  financially  liable  fw  the  total  amount  of  their  FMSO I 
individual  cases.  However,  they  are  only  required  to  deposit  five-seventeenths  of  this 
amount.  It  is  the  participant's  five-seventeenths  investment  that  gives  the  DOD  the 
authority  to  buy  and  store  items  in  anticipation  of  participant's  requisitions.  The  five- 
seventeenths  amount  equates  to  the  portion  of  items  in  the  FMSO  I  case  that  is  either  on 
order  or  on  the  shelf.  As  of  7  March  1994,  the  five-seventeenths  portion  of  the  collective 
FMSO  I  investment  ($1,086,275,576)  was  $319,492,816  (2:1).  Payment  of  the  twelve- 
seventeenths  portion  of  the  case  is  not  nOTcnally  collected.  However,  the  participant  is 
financially  liable  for  the  material  if  the  stocklevel  case  is  reduced  or  the  case  is  temunated 
(8:2-4). 

The  CLSSA  program  uses  the  FMSO  I  case  to  provide  demand  projections  and 
funding  for  the  purchase  of  follow-on  spare  and  repair  support  The  FMSO  n  case  is  an 
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annual  requisition  case  that  permits  the  CLSSA  participant  to  requisition  spares  and  repair 
parts  from  the  USAF  as  in-country  spares  are  consumed.  It  is  defined  in  terms  of  dollar 
value  and  does  not  identify  either  items  or  quantities  (8:9-1).  The  FMSO I  identifies  the 
participant's  spares  requirements,  financial  liability,  and  financial  investment  in  the  USAF 
and  Defense  Logistic  Agency  (DLA)  supply  systems.  The  spares  requirements  are 
identified  by  NSN  and  quantity  fca*  reparable  items  (investment  item)  on  a  FMSO  I 
requirements  listing.  The  NSN  and  quantity  listed  on  the  FMSO  I  requirements  listing  is 
referred  to  as  the  Stocklevel  Quantity  (SLQ).  The  spares  requirements  for  expendable 
(consumable)  items  are  managed  by  dollar  value  only.  The  dollar  value  of  expendable 
items  is  based  on  actual  {mgrammed  requisitions  received  over  the  last  two  years  adjusted 
to  an  average  seventeen  month  demand  (8:3-1  to  3-4).  The  CLSSA  concept  provides  the 
customer  and  the  USAF  with  numerous  economies  of  scale  resulting  in  reduced 
reprocurement,  inventory,  inventory  holding,  and  obsolescence  costs.  However,  most 
custcHners  feel  that  the  most  beneficial  portion  of  the  program  is  the  reduction  in  the 
supply  lead  times  for  spares  and  repair  parts. 

In  order  to  receive  the  full  benefits  of  the  CLSSA  program,  the  customer  must 
ensure  that  his  FMSO  I  case  contains  items  that  are  actively  used  by  his  country. 
Preferential  supply  treatment  offered  by  CLSSA  is  referred  to  as  'prograrruned'  support 
Through  the  proper  management  of  the  FMSO  I  case,  the  customer  can  ensure  that  all  his 
requirements  receive  programmed  support  The  benefit  of  a  programmed  requisition 
versus  a  nonprogrammed  requisition  is  in  the  amount  of  stock  on  the  shelf  that  can  be 
shipped  to  fill  the  requisition.  Programmed  requisitions  are  eligible  to  be  filled  from  stock 
down  to  the  zero  level.  Nonprogrammed  requisitions  are  eligible  to  be  filled  from  stock 
only  if  the  on  hand  assets  are  above  the  item  manager's  control  level.  Thus,  if  the  item 
manager's  asset  position  was  at  the  control  level  a  programmed  requisition  would  be 
immediately  filled  to  the  zero  level.  In  this  same  situation,  a  nonprogrammed  requisition 
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would  be  lead  time  away,  resulting  in  support  delay,  and  most  likely  an  increased  unit 
price  (8:9-1  to  9-5). 

There  are  two  criteria  that  must  be  met  for  the  requisition  to  receive  programmed 
suppon.  The  first  criterion  is  the  FMSO  n  requisition  itself.  The  requisition  is  eligible  to 
receive  programmed  support,  if  card  column  44  of  the  requisition  contains  an  "R"  or  a 
blank.  If  card  column  44  contains  an  "N",  the  requisition  is  treated  as  nonprogrammed 
regardless  of  criterion  two. 

Criterion  two  is  a  bit  more  complicated  and  relates  to  the  FMSO  I  case.  For  an 
investment  item  to  receive  programmed  support,  the  NSN  must  be  listed  on  the  FMSO  I, 
aiKi  the  quantity  of  the  requisition  must  be  less  than  or  equal  to  the  remaining  eligible  to  be 
programmed  quantity  (EP(^.  TheEPQ  is  the  portion  of  the  total  SLQ  that  has  not  been 
requisidoned  within  the  acmal  procurement  lead  time  of  the  item  (8:9-1  to  9-4).  For 
exan^le,  if  the  SLQ  is  20  and  the  EPQ  of  a  particular  NSN  is  20,  a  requisition  for  20 
would  receive  programmed  support  However,  if  the  requisition  was  submitted  for  30  the 
whole  requisition  would  be  coded  as  nonprogrammed.  Assuming  the  SLQ  and  EPQ  are 
20  as  before,  if  a  requisition  for  20  were  submitted  today,  the  total  quantity  of  the 
requisition  would  receive  programmed  support  and  the  EPQ  would  be  reduced  to  zero  for 
the  length  of  the  procurement  lead  time.  After  the  procurement  lead  time  had  expired,  the 
EPQ  would  be  increased  back  to  20  and  another  requisition  could  be  submitted  and 
receive  programmed  support  Any  requisition  submitted  while  the  EPQ  was  zero  would 
be  nonprogrammed.  For  expendable  items,  all  requisitions  are  coded  as  programmed  or 
noiprogrammed  based  on  criterion  one.  The  cxily  exceptitm  k>  this  rule  is  during  the  first 
year  of  the  CLSSA  program  or  a  Major  Add  to  the  dSSA  program,  resulting  from  the 
addition  of  a  new  wetqwn  system  (8:9-5). 
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FMSO  I  Devdopment  and  Modification 


The  FMSO  I  can  be  developed  and  modified  in  three  ways  -  Initial  Program, 

Major  Add  Programs,  and  File  Maintenance: 

a.  The  Initial  Program  is  used  when  a  participant  first  joins  the  CLSSA  program. 
Before  participation  in  the  CLSSA  program  the  participant  provides  the  USAF  with  the 
operational  and  maintenance  data  for  the  weapon  system  it  wishes  to  support.  Normally, 
the  USAF  System  Manager  (SM)  uses  this  infonnation  to  develop  a  recommendation  of 
items  and  quantities  required  to  support  the  system.  The  listing  of  recommended  items 
can  also  be  obtained  from  previous  FMS  demand  data,  contractor  data,  or  other  country 
data  sources.  SAMIS  processes  the  SM  recommendation  based  on  FMSO  I  Eligibility  and 
Exclusimi  Criterion.  The  results  of  this  processing  are  a  listing  of  items  eligible  for  the 
FMSO  I  (the  CLSSA  Recommendation  Listing)  and  a  listing  of  the  items  ineligible  for  the 
FMSO  I  (the  CLSSA  Ineligible  Item  Listing).  Hie  items  listed  on  the  CLSSA  Ineligible 
Item  Listing  may  be  procured  using  other  FMS  cases  specifically  designed  for  the 
procurement  of  the  non-CLSSA  items.  For  example,  ammunition  type  items  in  Federal 
Supply  Group  13,  although  required  for  weapon  system  support,  are  ineligible  for  the 
CLSSA  program.  However,  these  ammunition  items  can  be  ordered  on  an  unique  FMS 
case  with  an  "A"  case  designator  (8:2-2). 

The  CLSSA  Recommendation  Listing  contains  the  NSN,  quantity,  and  dollar  value 
for  investment  items  along  with  a  recommended  dollar  value  tmly  for  expense  items.  This 
listing  is  then  forwarded  to  the  participant  fcx-  modification  or  approval.  The  participant 
makes  any  desired  changes  and  returns  the  listing  to  AFSAC.  Afto:  the  modifications  are 
incorporated,  the  approved  items  and  values  (CLSSA  Stocklevel  Requirements  Listing) 
are  used  to  generate  the  FMSO  I  case  (8:2-1  to  3-4). 

b.  A  Major  Add  is  used  for  the  addition  of  a  new  weapon  system  or  a  large 
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number  of  items  for  a  cuirent  system  to  the  FMSO I  case.  Normally,  the  USAF  SM 
prepares  a  recommendation  of  the  items  to  be  added.  This  recommendation  is  then 
processed  by  SAMIS  to  generate  the  CLSSA  Recommendation  Listing  and  the  CLSSA 
Ineligible  Item  Listing.  After  the  country  reviews,  approves,  or  modifies  the  CLSSA 
Recommendation  Listing,  the  AFSAC  prepares  an  amendment  to  the  original  FMSO  I 
case  (8:6-1  to  6-5). 

c.  File  Maintenance  is  the  adjustment  of  FMSO  I  stocklevel  items  and  their 
quantities  as  the  participant's  requirement  changes.  File  maintenance  can  be  done  on  a 
daily  basis  by  the  use  of  file  maintenance  transactions.  File  maintenance  transactions  can 
decrease  or  increase  the  SLQ  by  NSN,  as  well  as  add  or  delete  a  NSN  from  the  CLSSA 
Stocklevel  Requirements  Listing.  The  participant  is  responsible  for  preparing  the  file 
maintenance  transactions  and  forwarding  them  to  the  AFSAC  case  manager  or  inputting 
them  directly  into  SAMIS  (8:4-1  to  4-5). 

Renegotiation  (Financial  Update) 

Since  the  FMSO  I  is  an  on-going  case,  the  value  can  vary  based  on  changes  in  the 
participant's  requirements.  AFSAC  renegotiates  the  FMSO  I  case  every  six  months  to 
financially  update  the  FMSO  I  case  value.  AFSAC  uses  the  participant's  two  year  demand 
history  and  the  existing  stocklevel  requirements  to  produce  a  CXSSA  Stocklevel 
Renegotiation  List  The  CLSSA  Stocklevel  Renegotiation  List  shows: 

1.  Catalog  Management  Data  including  noun,  source  of  supply,  unit  of  issue, 
procurement  lead  time,  Expendability,  Recoverability,  Repairability,  Category  code,  and 
Interchangeability  and  Substitution  Group  for  each  NSN  (8:7-1). 

2.  The  current  SLQ  for  each  investment  item  in  NSN  sequence  (8:7-1). 

3.  A  two  year  demand  history  by  program/nonprogram  code  (8:7-1). 
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4.  A  requirements  projection  based  on  the  demand  history  for  each  NSN  (8:7-1). 

The  renegotiation  list  was  intended  to  be  used  by  the  participants  to  evaluate  their 
current  investment  items'  SLQ  and  make  adjustments  based  on  current  and  projected 
operational  requirements  (8:7-2  to  7-3).  However,  for  many  CLSSA  participants, 
renegotiation  is  a  difficult  task.  Many  participants  do  not  have  established  procedures  to 
calculate  item  by  item  demand  requirements.  The  task  of  demand  calculation  is  frequently 
passed  to  junior  officers  who  do  not  have  the  experience  or  tools  necessary  to  make  good 
predictions.  This  results  in  items  and  quantities  on  the  QLSSA  that  did  not  receive  the 
level  of  customer  country  management  necessary  to  ensure  that  the  country’s  CLSSA 
reflects  their  actual  needs. 

A  methodology  is  required  that  will  match  the  spare  items  and  quantities  purchased 
under  (XSS  A  to  the  actual  foreign  customers'  demands.  At  the  present,  over  36%  of  the 
investment  items  bought  under  the  current  USAF  CLSSA  procedures  have  not  been 
ordered  by  any  customer  over  the  past  four  years  (1:1).  This  means  that  the  foreign 
customers'  investment  purchased  items  that  are  no  longer  required  or  are  very  low 
demand  items  (items  which  were  demanded  less  than  once  every  four  or  more  years).  The 
funds  used  for  these  purchases  could  have  been  used  more  effectively,  if  a  method  existed, 
to  accurately  predict  the  items  actually  demanded.  The  estimated  amount  of  funds 
obligated  to  these  "no  demand"  items  is  around  $319M  out  of  a  $1B  program.  This 
amount  has  been  growing  over  the  last  few  years  at  a  7  to  10  percent  rate  (1:1).  FMS 
customers  are  rightly  concerned  because:  1)  the  items  on  the  shelf  are  tying  up  funds  that 
could  be  used  for  the  procurement  of  high  turnover  items,  and  2)  the  price  of  the  items  is 
constantly  increasing  (through  inflation  and  storage  charges). 

The  impact  on  problem  two  has  been  greatly  increased  by  the  USAF 
implementation  of  Defense  Management  Review  Decision  (DMRD)  904  in  October  1992. 
DMRD  904  directed  the  stock  funding  of  reparables  (7:6-7).  Stock  funding  had  a  direct 
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impact  on  CLSSA  investment  items  because  almost  all  investment  items  are  reparables. 
Before  reparables  could  be  convened  to  the  stock  fund  concept,  the  reparable  inventory 
had  to  be  capitalized.  This  capitalization  action  increased  the  price  of  CLSSA  investment 
items  in  inventory  between  5  and  37  percent  (2:1).  The  percentage  of  increase  was  based 
on  the  date  of  the  last  procurement  (acquisition  cost).  If  the  item  had  not  been  bought  for 
years,  as  in  the  case  of  some  F-1 1 1  and  F-5  aircraft  components,  the  price  increased  close 
to  37  percent  (2:2). 

Prior  to  the  implementation  of  DMRD  904  the  stock  list  price  of  an  item  was  only 
updated  (increased  or  decreased)  when  a  reprocurement  action  was  taken.  This  meant 
that  once  the  CLSSA  cusmmer  added  an  item  to  the  I^SO  I  case,  it  could  remain  on  the 
case  indefinitely  without  experiencing  a  price  increase,  even  if  there  was  no  usage  for  the 
item.  However,  under  DMRD  904,  the  price  of  the  item  will  be  adjusted  (increased  or 
decreased,  but  mostly  increased)  each  year.  Therefore,  if  the  customer  maintains  an 
inactive  item  on  the  FMSO I  case,  and  the  price  of  the  item  increases  each  year,  the 
customer  will  be  assessed  a  higher  price  to  keep  the  item  on  the  FMSO  I  case  (the  5/17 
amount  required  to  be  on  deposit  will  increase).  In  addition,  the  customer  will  be  assessed 
a  higher  price  (the  current  stock  list  price)  when  the  customer  removes  the  item  from  the 
case  with  a  file  maintenance  transaction  (7:6-7).  Thus  implementation  of  DMRD  904 
imposed  a  twofold  penalty  on  the  CLSSA  customers  who  do  not  actively  manage  the 
NSNs  on  their  FMSO  I  case. 

Current  Method 

The  current  USAF  CLSSA  process  relies  on  each  customer  country  to  predict  the 
investment  items  by  NSN  and  quantity  to  which  each  customer's  (XSSA  investment  funds 
should  be  applied.  AFSAC  intends  to  shift  the  CLSSA  program  from  a  manual  customer 
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country  item/quandty  management  basis  to  an  automated  item/quantity  management  basis 
where  calculations  are  based  on  historical  country  demands  against  the  USAF  supply 
system.  A  method  needs  to  be  identified  that  accurately  predicts  CLSSA  investment  items 
on  a  quarterly  basis  from  historical  demand  data.  This  method  must  also  be  capable  of 
quickly  adjusting  for  increasing  or  decreasing  demand  trends  within  the  procurement  lead 
time  or  the  repair  turn  around  time  of  the  item.  Accurate  forecasting  of  future  CLSSA 
reparable  demands  is  vital  to  the  successful  operation  of  the  new  USAF  CLSSA  program. 

Specific  Problem 

The  purpose  of  this  research  was  to  examine  the  ability  of  four  time-series  based 
forecasting  methods  to  improve  the  quality  of  the  FMSO I  stocklevel.  For  this  thesis,  a 
quality  stocklevel  is  defined  as  one  that  identically  matches  the  customer's  actual 
reg<'ireinents,  in  terms  of  having  the  correct  NSN  and  quantity  available,  when  a  customer 
demand  is  received.  The  quality  of  the  forecasted  stocklevel  was  determined  by  measuring 
the  amount  of  error  between  the  stocklevel  quantiQr  forecasted  by  the  models  and  the 
actual  CLSSA  quantity  demanded.  Based  upon  experience  with  tlie  CLSSA  program  and 
the  information  obtained  in  the  literature  review,  three  traditional  forecasting  methods 
were  selected  that  appeared  to  offer  the  greatest  potential  for  producing  accurate  CLSSA 
forecasts.  The  three  traditional  forecasting  methods  are  double  exponential  smoothing, 
adaptive  response,  and  classical  decomposition.  The  results  fiom  these  methods  were 
compared  with  a  unique  time-series  method  developed  by  the  AFSAC,  called  the 
"retention  formula."  The  product  of  this  research  was  a  rank  order  listing  of  the  tested 
methods  based  upon  the  accuracy  of  each  method  to  predict  the  quantity  of  future  CLSSA 
demands.  This  research  focuses  on  identifying  whether  an  automated  method  of 
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predicting  investment  item  demands  will  outperform  the  current  manual  method  of 
predicting  future  CLSSA  requirements. 

Investigative  Questions 

1.  How  accurate  are  the  forecasting  methods  in  predicting  future  CLSSA  demands? 

2.  To  what  extent,  if  any,  will  trends,  cycles,  and  seasonality  have  on  the  accuracy  of  the 
forecast? 

3.  What  degree  of  improvement,  if  any,  is  achieved  by  each  of  the  four  forecasting 
methods  over  the  current  method? 

4.  What  degree  of  improvement,  if  any,  is  achieved  by  the  three  traditional  forecasting 
methods  over  the  proposed  AFS  AC  forecasting  method? 

5.  In  general,  will  forecasting  based  on  historical  demands  result  in  higher  or  lower 
quantities  of  CLSSA  reparable  (investment)  requirements  compared  to  the  current 
method? 

6.  In  general,  will  the  amount  of  investment  fui^  need  to  increase  to  support  the 
quarterly  CLSSA  reparable  requirements  predicted  by  the  forecasting  method? 

Scope  and  Limitations 

This  research,  sponsored  by  the  AFSAC  concentrates  on  the  USAF  high  cost, 
reparable  items  which  the  CLSSA  refers  to  as  investment  items.  The  research  task 
examines  several  potential  methods  to  calculate  the  items  and  quantities  to  be  purchased 
with  the  FMS  customer  investment  in  the  CLSSA  and  to  determine  which  method 
provides  the  greatest  benefit  to  the  CLSSA  participants.  This  research  does  not: 

1)  adthtess  the  overall  performance  of  the  CLSSA  program 
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2)  evaluate  the  benefits  of  using  a  stock  fund  concept  for  reparable  items 

3)  discuss  the  accuracy  of  the  methods  used  to  develop  the  US  AFs  initial  or 
Major  Add  recommendations 

4)  measure  the  performance  of  the  DOD  supply  system  after  the  quarterly 
requirements  are  forwarded 

5)  assess  the  appropriateness  of  selecting  5/17  of  the  FMSO I  value  as  the 
country's  investment  in  the  CLSS  A 

6)  examine  the  validity  of  the  periodic  repricing  of  investment  items  already  in  the 
inventory  to  adjust  for  inflation 

7)  analyze  the  forecasting  algorithms  coded  in  the  forecasting  software  package 
used  in  this  researclL 
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IL  Literature  Review 


Introduction 

This  literature  review  examines  aspects  of  inventory  management  relevant  to  the 
USAF  investmentAeparable  item  portion  of  the  Cooperative  Logistics  Supply  Support 
Anangement  (CLSS  A)  program.  The  first  part  addresses  the  legislative  environment  that 
has  dictated  a  change  in  the  method  of  managing  reparables.  The  next  section  focuses  on 
the  need  to  select  an  appropriate  forecasting  method  to  manage  CLSSA  reparable  items. 
Hnally,  the  review  examines  the  forecasting  dilemma  and  die  major  traditional  frxecasting 
methods  which  are  potentially  applicable  to  the  research  problem. 

Background 

The  CLSSA  is  a  Foreign  Military  Sales  (FMS)  supply  support  agreement  that 
permits  foreign  governments  to  invest  funds  in  the  Department  of  Defense  (DOD)  supply 
system.  These  foreign  investment  funds  are  used  by  the  USAF  to  augment  the  DOD's 
stocklevels.  CLSSA  customers  benefit  tiom  participation  by  having  their  requisitions  filled 
directly  fitom  DOD  inventories.  The  Defense  Institute  of  Security  Assistance  Management 
defines  CLSSA  as. 

Military  logistics  support  arrangements  designed  R>  provide 
responsive  and  continuous  supply  supptm  at  the  depot  level  for  US  made 
military  materiel  possessed  by  foreign  countries  and  international 
organizations.  The  CLSSA  is  normally  the  nx>st  effective  means  for 
providing  common  repair  parts  and  secondary  item  suppon  for  equipment 
of  US  origin  which  is  in  allied  and  friendly  country  inventories  (19:562). 
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For  the  CLSSA  to  operate  efficiently,  the  investment  funds  must  be  used  to 
purchase,  in  advance,  the  range  and  depth  of  items  that  will  be  ordered  in  the  future  by 
CLSSA  participants.  At  present,  over  36  percent  of  the  investment  items  bought  under 
the  USAF  CLSSA  program  have  not  been  ordered  by  any  FMS  customer  over  the  past 
four  years;  therefore,  an  improvement  in  forecasting  methods  is  warranted  (1:1). 

Research  Purpose 

The  purpose  of  this  research  was:  1)  to  compare  the  accuracy  of  four  forecasting 
methods  in  predicting  CLSSA  quarterly  investment  item  demands,  2)  to  compare  the 
performance  of  the  most  accurate  to  the  current  CLSSA  program,  and  3)  to  identify  the 
most  accurate  of  these  four  forecasting  methods  for  possible  use  by  the  new  USAF 
CLSSA  program. 

• 

Legislative  Environment 

Two  Defense  Management  Review  Decisions  (DMRDs)  had  a  drastic  in:q)act  on 
the  CLSSA  program.  DMRD  971  set  guidelines  for  a  new  revolving  fund,  the  Defense 
Business  Operations  Fund  (DBOF).  The  DBOF  directed  the  development  of  a  cost  per 
output  system  for  DOD  implementation  jq)plicable  to  every  management  level.  The 
DBOF  permits  identical  measurements  in  like  functions.  The  DBOF  measures  are 
responsible  for  the  creation  of  the  Cost  of  Operation  Division  (COD)  portion  of  the 
reparable  stock  fund  (6:1-8).  DMRD  904  directed  the  stock  funding  of  reparables  (7:6-7), 
Before  reparables  could  be  converted  to  the  stock  fund  concept,  the  reparable  inventory 
had  to  be  capitalized.  This  capitalization  action  increased  the  inventory  cost  of  reparable 
items  in  the  CLSSA  program  between  5  and  37  pment  (2:1).  The  percentage  of  increase 
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was  based  on  the  date  of  the  last  procurement  (acquisition  cost).  If  the  item  had  not  been 
bought  for  years,  as  in  the  case  of  the  F-1 1 1  and  F-5  aircraft,  the  price  increased  close  to 
37  percent  (2:2).  Below  is  an  excerpt  from  the  Stock  Fund  Operations  DOD  Directive  on 
the  capitalization  process: 

The  acquisition  cost  is  used  to  establish  an  item's  standard  price. 

For  items  without  a  procurement  history,  an  acquisition  cost  is  estimated 
based  upon  current  manufacturer's  price  listings  or  market  quotations.  The 
acquisition  cost  of  an  item  procured  by  a  multi-year  contract  may  include 
up  front  costs  such  as  set  up  cost  that  will  not  be  incurred  in  future  years. 

(3:4-1) 

Need  for  Forecasting 

Today's  managers  need  to  imderstand  how  the  stock  fund  process  works  and  how 
it  impacts  their  programs.  In  an  environment  where  limited  funding  resources  must  be 
maximized  to  get  the  best  return  on  investment,  efficient  management  of  operations  and 
maintenance  dollars  under  the  stock  fund  concept  is  critical.  As  the  military  focuses  on 
the  cost  of  doing  business,  stock  funds  will  take  on  increased  importance  (4:1-2).  It  may 
not  be  long  before  almost  every  item  issued  through  the  (XSS  A  program  will  be  stock 
funded.  The  USAF  CLSSA  program  must  adjust  its  management  philosophy  to  survive. 

Inventory  control  is  a  key  aspect  of  stock  fund  management  Accurate,  reliable 
requirements  determination  processes  are  required  to  ensure  the  funire  readiness  demands 
are  realistic  (9:1-2).  Proper  development  ami  application  of  trend  analysis  provides 
managers  capability  to  accurately  project  future  levels.  By  conq)aring  past  and  present 
performance  with  known  future  projects,  managers  will  possess  the  required  information 
to  make  accurate  inventory  decisions.  Forecasting  sales  becomes  a  tool  for  sound 
financial  management  (5:29-165). 

The  CLSSA  program  was  structured  to  allow  the  FMS  customers  to  adjust  the 
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National  Stock  Number  and  quantity  of  investment  items  on  a  daily  basis  as  their  demand 
for  the  item  changed  (8:4-1  to  5-3).  It  was  envisioned  that  customers  would  be  in  the  best 
position  to  know  their  own  future  requirements.  This  philosophy,  however,  has  resulted 
in  an  average  customer.error  of  36  percent  (1:1).  Customer  error  is  defined  as  adding  the 
NSN  to  the  FMSO I  case  and  then  not  placing  a  requisition  for  the  item.  In  addition,  14 
percent  of  the  items  added  by  the  FMS  customer  in  the  last  four  years  have  not  been 
requisitioned.  Overall  only  about  45  percent  of  investment  item  requisitions  are  coded 
programmed  (24: 1 ). 

The  impact  of  having  incorrect  items  on  the  CLSS  A  stocklevel  case  prior  to  the 
implementation  of  the  stock  fund  was  that,  ovoall,  55  percent  of  the  country's  investment 
was  inconectly  allocated  based  on  their  demand  patterns  (1:1).  Since  the  cost  of  these 
items  was  recorded  at  historical  procurement  prices,  the  amount  of  error  (incorrect 
investment)  remained  the  constant  However,  under  the  stock  fund  capitalization  concept, 
the  cost  of  leaving  incorrea  items  on  the  GLSSA  stocklevel  case  increases  each  year.  The 
use  of  accurate  forecasting  and  Air  Force  Stock  Fund  reports  will  help  management 
overcome  the  pitfall  of  allowing  inventory  to  grow  unnecessarily  by  not  knowing  what  the 
customer  needs. 

US  AF  Reparable  Forecasting  Methods 

Since  (XSSA  forecasts  interface  with  the  USAF  D041  reparable  management 
system  on  a  quarterly  basis,  it  is  beneficial  to  understand  the  D041  forecasting  model.  The 
D()41  system  uses  a  single  moving  average  forecasting  model  which  uses  the  most  recent 
eight  quarters  of  data  as  its  basic  forecasting  method.  The  basic  nnodel  is  supplemented 
with  a  weighted  single  moving  average  forecasting  model  to  compute  the  overall  demand 
rate.  Consequently,  it  is  important  to  understand  that  when  the  quarterly  programs  follow 
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a  decreasing  trend,  the  computed  weighted  single  moving  average  demand  rate  will  be  less 
responsive  to  the  trends  in  the  quarterly  rates  than  will  the  single  moving  average.  Also,  if 
the  quarterly  program's  demand  rate  follows  an  increasing  trend,  the  computed  weighted 
demand  rate  will  be  smaller  than  the  single  moving  average  of  the  rates.  Where  the 
program  is  approximately  constant  over  time,  the  weighted  demand  rate  is  essentially 
computed  using  the  single  moving  average  (10:  28-34,41).  The  D041  model  emphasizes 
that  forecaster  need  to  pay  attention  to  changes  in  the  direction  of  the  variables,  as  well 
as  the  average  value  of  the  variables  (1 1:162-163). 

Forecasting  Dilemma 

An  anonymous  author  correctly  summarized  the  forecasting  dilemma  by  the 
statement  "The  future  isn't  what  it  used  to  be"  (12:49).  Forecasts  are  intended  to  describe 
what  will  happen  in  the  future  given  a  set  of  circumstances  (13:4).  Difficulties  arise  when 
the  set  of  circumstances  is  dynamic  and  fluctuates  over  time  (16:445).  Most  forecasts  of 
demand  are  reliable  for  a  short  time  period  into  die  future;  however,  the  validity  of  the 
forecast  can  drastically  deteriorate  within  a  very  shon  period  depending  upon  the 
characteristics  of  the  forecasting  environment  (17:60).  Effective  forecasting  must  match 
the  characteristics  of  the  situation  or  process  at  hand  with  the  characteristics  of  a 
forecasting  methodology  (13:33).  Demand  data  consist  of  four  basic  patterns  which  must 
be  analyzed  separately  to  assure  forecast  accuracy  (16:445).  The  four  basic  data  patterns 
are  irregular,  seasonal,  cyclical  and  trend.  The  irregular  pattern  contains  apparent  random 
and  unexplainable  changes  over  time  with  no  systematic  pattern  of  increasing  or 
decreasing.  This  pattern  is  often  referred  to  as  noise.  The  seasonal  pattern  displays 
fluctuations  according  to  some  time  related  factor  within  a  year  (13:20).  A  trend  pattern 
is  a  general  increase  or  decrease  in  the  value  of  the  forecasted  variable  over  time.  The 
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cyclical  pattern  is  similar  to  the  seasonal  pattern,  but  the  patterns  recur  at  intervals  longer 
than  one  year.  The  cyclical  pattern  is  difficult  to  detect  since  it  does  not  repeat  frequently. 
This  pattern  consists  of  a  general  tendency  of  continued  increase  or  decrease  over  a 
relatively  long  period  of  time  (13:21). 

Accurate  forecasting  requires  a  model  that  matches  the  characteristics  of  the 
process  under  consideration.  The  four  primary  rruxlel  categories  are  briefly  described 
below  (13:25-26): 

Time-series  -  This  model  assumes  that  a  historical  pattern  exists  and  that  this 
pattern  will  recur  over  time.  Knowledge  of  the  historical  pattern  permits  prediction  of  a 
future  period. 

Explanatory  -  This  model  assumes  that  the  value  of  the  dependent  variable  is  a 
function  of  several  independent  variables  rather  than  as  a  function  of  time.  Computation 
methods  involve  use  of  multiple  regression  analysis.  If  this  model  is  to  be  applied  for 
future  periods,  accurate  forecasts  of  each  contributing  variable  must  be  calculated  before 
the  variable  of  interest  can  be  calculated. 

Statistical  •  This  model  uses  statistical  analysis  to  identify  variable  patterns  and  to 
determine  the  reliability  of  forecasts.  Although  these  models  are  more  precise  than  others, 
they  are  not  used  extensively  due  to  their  complexity  and  difficulty  in  practically  applying 
the  results. 

Nonstatistical  -  This  model  is  based  upon  intuitive  inputs  rather  than  quantitative 
input  and  analysis.  These  are  the  "common  sense"  models  used  to  estimate  future  values. 

Forecasting  Methodologies 

The  following  traditional  methodologies  were  identified  during  the  literature 
review  as  possible  candidates  for  use  in  CLSS  A  investment  item  forecasting.  Three 
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traditional  forecasting  methods  will  be  selected  based  on  their  ability  to  predict  the  future 
using  a  historical  time  series. 

Naive  I  -  This  simple  approach  just  uses  the  most  recentiy  observed  value  as  the 
forecast  value.  This  method  gives  no  weight  to  other  past  observations  (13:37;  14:21; 
15:570;  16:499). 

Naive  n  -  This  method  is  the  same  as  Naive  I  except  the  current  observation  is 
deseasonalized  to  a  generic  value.  The  observed  value  is  then  reseasonalized  using  the 
seastxial  factors  applicable  to  the  particular  forecast  period.  Both  of  the  naive  methods 
are  useful  to  establish  a  baseline  m  compare  competing  alternate  models  to  determine 
whether  the  additional  accuracy  of  the  more  sophisticated  methods  is  worth  the  additional 
time  and  cost  (13:37;  14:21;  15:571;  16:449). 

Single  Moving  Average  -  This  method  seeks  to  minimize  the  random  fluctuations 
of  the  naive  methods.  An  average  value  is  computed  by  summing  the  observed  values  of 
several  periods  and  then  dividing  the  summed  value  by  the  number  of  periods.  Each  . 
period  is  given  equal  weight  in  the  forecast  The  "moving"  element  is  derived  from 
dropping  the  observed  value  from  the  oldest  period  and  replacing  it  with  the  observed 
value  from  the  most  recent  period.  Significant  drawbacks  of  this  method  include  negating 
seasonal  factors  through  die  averaging  process  and  a  slow  response  to  changes.  The 
greater  the  number  of  periods  included  in  the  average,  the  greater  the  "smoothing"  effect 
will  be  on  the  fluctuations  in  the  historical  observed  values.  Because  of  these  limitations, 
the  moving  average  should  only  be  used  for  forecasting  variables  that  exhibit  a  flat  data 
pattern  with  little  randomness  (13:55-61;  14:44-49;  15:45-48;  16:454-455). 

Dmible  Moving  Averages  -  This  model  first  computes  a  single  moving  average 
value  using  observed  data  as  described  above.  A  second  average  is  then  computed.  This 
secoiKl  average  is  computed  using  historical  single  moving  average  data  from  past  periods. 
The  difference  in  value  between  the  single  moving  average  value  and  the  double  moving 
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average  is  added  back  to  the  single  moving  average  value  to  airive  at  a  forecast  value. 

The  drawback  to  double  moving  averages  is  that  twice  the  amount  of  data  points  are 
required  as  the  single  moving  average  method.  The  strength  is  that  they  produce  much 
more  accurate  forecasts  when  the  data  displays  a  increasing  or  decreasing  trend  (13:67-70; 
14:48-54;  15:56-60;  16:454-455). 

Single  Exponential  .Smoothing  -  This  method  is  similar  in  concept  to  the  moving 
average  except  equal  weight  is  not  given  to  each  observed  value.  Greater  weight  is  given 
to  the  most  recently  observed  values  by  applying  exponential  weights.  The  amount  of 
weight  placed  on  each  observed  value  decreases  as  the  historical  data  becomes  older.  An 
alpha  term  (between  0  and  1)  controls  the  degree  of  smoothing  in  the  forecast.  Higher 
values  of  alpha  provide  little  smoothing  and  result  in  a  greater  response  to  recent  changes 
in  observations.  Lower  values  of  alpha  provide  greater  smoothing  of  the  fluctuations  in 
the  data  (13:61-65;  14:58-66;  15:48-53;  16:455-458). 

Double  Exponential  Smoothing  -  This  method  in  concept  is  similar  to  the  double 
moving  average  method.  In  this  method,  a  single  exponential  smoothed  value  is 
calculated.  Next,  a  double  exponential  smoothed  value  is  calculated  using  the  single 
exponential  smoothed  values  as  input  The  difference  between  these  two  calculations  is 
added  back  to  the  single  smoothed  value  for  a  forecast  value.  Double  exponential 
smoothing  produces  more  accurate  results  than  single  exponential  smoothing  when  trend 
patterns  exist  in  the  data.  Research  has  found  that  the  double  exponential  smoothing 
method  always  produces  more  accurate  results  than  the  double  moving  average  method 
(13:70-73;  14:79-80;  15:55-60). 

Winters'  Three  Parameter  Linear  aral  Seasonal  Exponential  Smoothing  -  This 
method  is  similar  to  double  exponential  smoothing  except  it  has  the  capability  to 
incorporate  both  a  trend  adjustment  and  a  seasonal  adjustment.  This  method  involves 
three  equations.  Each  of  the  equations  smoothes  one  of  three  patterns  (randonmess,  trend 
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and  seasonal  components)  in  the  data.  The  drawback  to  this  method  is  that  various 
smoothing  values  must  be  selected  on  a  trial  and  error  basis  to  identify  the  combination 
that  produces  the  smallest  mean  square  of  error  (13:73-78;  14:98-105;  15:72-73;  16:458). 

Harmonic  Smoothing  -  This  method  is  specifically  oriented  towards  calculating 
seasonality  in  time  series  data.  The  method  uses  Fourier  analysis  to  transform  the  data  to 
sine  and  cosine  terms  for  the  calculations.  In  situations  where  data  is  limited,  this  method 
tends  to  predict  seasonal  turning  points  better  than  exponential  smoothing;  however,  when 
adequate  data  is  available,  decomposition  and  autoregressive  moving  averages  perform 


better  (14:184). 

Adaptive  Response  -  This  method  uses  weighted  historical  data  to  forecast  future 
values.  The  value  of  the  weight  applied  to  each  historical  data  value  is  recalculated  for 
each  new  forecast  period.  The  amount  of  adjustment  to  the  weights  is  based  upon  the 
amount  of  error  that  occurred  between  the  previous  period's  forecast  value  and  actual 
value.  This  is  a  dynamic  method  where  the  weights  will  be  continuously  adjusted.  The 
adaptive  c^ability  of  this  method  permits  it  to  effectively  respond  to  changes  in  the 
patterns  of  the  underlying  data.  This  method  usually  produces  more  accurate  results  than 
the  moving  average  and  exponential  smoothing  methods;  especially  when  the  historical 
data  contains  a  complicated  underlying  pattern  (13:82-96;  14:266-274;  15:286-299). 

Simple  Regression  -  This  is  an  explanatory  method  rather  than  a  time  series 
method.  This  method  assumes  a  underlying  linear  pattern  in  the  historical  data.  Unlike 
time  scries  methods,  this  method  makes  predictions  based  upon  a  causal  relationship 
between  a  readily  measured  indq)endent  variable  and  the  unknown  value  of  the  dependent 
variable.  A  mathematical  linear  equation  calculatts  a  line  which  predicts  the  value  of 
dependent  variable  given  the  value  of  the  dependoit  variable  as  input.  Statistical  analysis 
of  the  equation  permits  identification  of  comtidence  intervals,  coefficient  of  correlation  and 
coefficient  of  determination.  These  statistical  calculations  reveal  the  usefulness  of  the 
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linear  model  in  predicting  values  of  the  dependent  variable  (10:455-522;  13:101-121; 
14:120-127;  15:146-165;  16:464-465). 

Multiple  Regression  -  This  method  is  essentially  the  same  as  simple  regression  and 
correlation  except  multiple  independent  variables  are  included  in  the  model.  The  addition 
of  multiple  independent  variables  typically  permits  greater  accuracy  in  predicting  the 
dependent  variable's  value.  The  goal  of  multiple  regression  is  to  identify  and  include  the 
key  variables  that  influence  the  value  of  the  dependent  variable.  Drawbacks  of  multiple 
regression  include  high  costs  to  gather  data  continually  on  the  independent  variable  and 
difficulties  in  determining  when  the  causal  relationship  between  the  dependent  and 
independent  variable  changes.  As  a  result,  multiple  regression  is  generally  used  to  forecast 
aggregate  variables  such  as  overall  level  of  economic  activity  rather  than  for  individual 
variables  such  as  demands  for  specific  products  (10:522-589;  13:146-168;  14:363-382; 
15:180-220). 

aassical  Decomposition  -  Most  time  series  methods  attempt  to  produce  forecasts 
by  accounting  for  the  cumulative  impacts  of  trend  factOTS,  cyclical  factors  and  seasonal 
factors.  The  decomposition  method  separates  the  overall  data  pattern  into  individual 
subparts  of  trendy  cycle  and  seasonal  elements.  This  method  can  be  used  to  explain 
fluctuations  in  data  values  and  permits  predictions  to  be  tailored  to  reflect  trend,  cycle  and 
seasonal  changes  (13:123-145;  14:198-209;  15:88-138). 

Univariate  Autoregressive  Moving  Average  (ARMA)  -  This  category  of  methods 
uses  one  independent  variable  (univariate)  to  predict  the  dependent  variable. 
Autocorrelation  calculations  determine  patterns  within  the  data.  Autocorrelation  is  the 
amount  of  correlation  which  exists  between  values  of  the  same  variable  measured  at 
incremental  time  intervals.  For  example,  die  correlation  between  seasonal  temperature 
measured  at  12  month  intervals  constimtes  an  autocorrelation  calculation.  The  term 
"autoregressive"  identifies  the  similarity  to  the  single  and  multiple  regression  methods. 
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Here,  the  independent  variable  values  are  simply  the  values  of  a  single  variable  measured 
at  different  time  lag  periods  from  the  current  period.  The  term  "moving  average"  refers  to 
using  the  average  difference  between  predicted  and  actual  values  from  past  periods  in 
making  the  current  forecast  This  category  of  methods  has  proven  to  be  very  accurate  but 
these  methods  are  complex  and  expensive  in  terms  of  computer  time  to  operate.  As  a 
result,  there  has  not  been  a  large  amount  of  practical  application  (13:171-196;  14:383- 
387;  15:328-361). 

Multivariate  Autoregressive  Moving  Average  -  This  category  of  methods  utilizes 
the  same  processes  as  ARMA  methods  but  permits  inclusion  of  multiple  variables  in 
predicting  the  value  of  the  dependent  variable.  Inputs  from  the  additional  variables  make 
the  forecasts  more  accurate  but  also  make  these  methods  even  more  complex,  difficult  to 
use  and  costly  to  develop  than  uiuvariate  ARMA  methods  (13:197-198;  14:387-392; 
15:376-428). 

Selected  Forecasting  Methods 

The  three  traditional  forecasting  methods  of  double  exponential  smoothing, 
classical  decomposition,  and  adaptive  filtering  were  selected  based  on  the  literature 
review's  indication  that  these  methods  were  the  most  accurate  using  the  hypothesized 
(XSSA  underlying  time  series  data  patterns.  The  double  exponential  smoothing  method 
was  selected  as  the  time  series  based  method  that  provided  the  most  accurate  results  under 
the  assumption  that  trends,  cycles,  and  seasonal  impact  did  not  exist  in  the  data.  The  two 
arklitional  models,  the  adaptive  filtering  and  the  classical  decranposition  models,  were 
selected  based  on  their  ability  to  enhance  the  time-series  forecast  using  underlying  trends, 
cycles,  and  seasonality. 
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The  three  traditional  forecasting  methods  of  double  exponential  smoothing, 
classical  decomposition,  and  adaptive  response  were  selected  for  testing  based  on  the 
literature  review's  indication  that  these  methods  would  be  the  most  accurate  analytical 
forecasting  methods  that  correspond  to  the  presumptive  patterns  within  the  data.  The 
double  exponential  smoothing  method  was  selected  as  the  time  series  based  method  that 
provided  the  most  accurate  results  under  the  assumption  that  trends,  cycles,  and  seasonal 
impact  did  not  exist  in  the  data.  The  two  additional  models,  the  adaptive  response  and  the 
classical  decomposition  models  were  selected  based  on  their  ability  to  enhance  the  time- 
series  forecast  using  underlying  trends,  cycles,  and  seascaiality. 

This  chapter  presented  background  information  on  the  QLSSA  program  and  some 
of  the  reasons  why  a  new  CLSS  A  forecasting  method  is  required.  The  purpose  of 
forecasting  is  to  isolate  the  basic  pattern  in  the  historical  data  and  then  use  this  knowledge 
as  a  basis  to  predict  future  values.  The  accuracy  of  the  forecast  depends  upon  selection  of 
the  cotrea  category  of  model  that  reflects  the  characteristics  of  the  particular  forecasting 
situation.  A  number  of  forecasting  methodologies  have  been  developed  in  response  to  the 
various  types  of  data  patterns.  This  review  briefly  described  nine  major  forecasting 
methods  which  could  be  applied  in  CLSS  A  forecasting  research. 

Chapter  m  describes  the  methods  to  be  employed  to  test  the  performance  of  four 
models  in  predicting  CLSSA  investment  item  demands.  The  models  tested  were  double 
exponential  smoothing,  adaptive  response,  and  classical  deccxnposition.  A  discussion  of 
the  test  results  is  presented  in  Chapter  IV. 
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m.  Methodology 


Chapter  Overview 

This  ch£^ter  describes  the  population  of  interest  and  the  research  design  utilized  to 
control  and  select  the  sample  data  used  in  this  study.  The  forecasting  methodologies 
applied  are  then  taiefly  described  followed  by  an  oudine  of  the  forecasting  process  and  a 
description  of  the  forecasting  software.  Next,  performance  measures,  cost  measures  and 
validity  issues  are  discussed.  Finally,  the  limitations  of  the  research  methods  are 
presented. 

Controlling  Population  of  Interest 

This  research  focused  on  examining  the  demand  characteristics  of  Cooperative 
Logistics  Supply  Support  Arrangement  (CLSSA)  investment  items.  The  population  of 
interest  is  all  USAF  CLSSA  investment  item  records.  The  CLSSA  program  began  in 
mid- 1962  and  utilized  the  H051  computer  system.  In  1983,  the  International  Logistics 
Center  converted  to  a  new  computer  system  named  the  Security  Assistance  Management 
Information  System  (SAMIS).  Although  SAMIS  contains  all  USAF  Foreign  Military 
Sales  (FMS)  requisitions,  for  the  purposes  of  this  research,  only  records  of  CLSSA 
investment  item  demands  were  of  interest  For  analysis  purposes,  the  population  of 
CLSSA  records  was  further  reduced  to  a  ten  year  sample  period.  The  range  of  sample 
data  covers  the  period  from  1  January  1984  to  31  DecembCT  1993.  This  continuum  of 
data  was  segmented  into  chronological  quaners  m  coincide  with  the  USAF  quarterly 
forecasting  method.  This  ten  year  range  produced  40  quarters  of  data  which  is  considered 
a  large  sample  for  statistical  analysis.  This  range  of  data  includes  the  implementation  of 
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Ac  Defense  Management  Review  Decision  (DMRD)  904  on  30  September  1992, 
Operation  Desen  Shield  from  2  August  1990  through  17  January  1991,  and  Desen  Storm 
from  17  January  1991  through  28  February  1991  as  possible  distortions  to  Ae  data 
patterns.  However,  it  was  felt  Aat  Ae  chosen  forecasting  model  must  be  able  to  react  to 
demand  fluctuations  as  a  result  of  Ae  legislative  or  political  situation. 

Sample  Selection 

The  population  of  CLSSA  mvestment  items  consists  of  10,969  National  Stock 
Numbers  (NSNs).  It  was  hypoAesized  Aat  dividing  Ae  sample  mto  three  categories 
based  upon  number  of  demands  would  provide  Ae  opportunity  to  measure  each  model's 
performance  to  forecast  based  on  volume  of  historical  demands.  The  three  demand 
categories  are  referred  to  as  low,  medium  and  high.  To  improve  Ae  validity  of  Ae  results, 
a  statistically  large  number  of  NSNs  was  required  m  each  category.  Statistically,  a  sample 
size  of  at  least  30  is  considered  large  (18:35).  For  Ais  reason,  at  least  30  NSNs  were 
desired  m  each  category.  Additionally,  Ae  population  was  hypoAesized  to  display  a 
normal  distribution,  meaning  Aat  approximately  one  Aird  of  Ae  total  number  of  NSNs 
would  fall  into  one  of  Ae  low,  medium  or  high  demand  categories.  Based  on  Ae  above 
information,  a  sample  size  of  1(X)  NSNs  wiA  demand  data  was  desired.  However,  Ae 
literature  review  indicated  Aat  approximately  36  percent  of  Ae  NSNs  A  Ae  population 
would  not  have  any  demand  data  (1:1).  Therefore,  m  order  to  obtain  a  usable  sample  size 
of  100  NSNs,  it  was  necessary  to  select  136  NSNs  from  Ae  population. 

From  Ae  population,  136  NSNs  were  randomly  selected  to  be  used  as  sample  data 
for  comparing  forecasting  meAodologies.  A  statistics  software  program,  Statistix  Version 
4.0,  was  used  to  generate  136  random  numbers  between  Ae  values  of  zero  and  one  (27). 
Each  random  number  was  multiplied  by  10,969,  truncated  to  Ae  closest  whole  number 
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and  then  one  was  added  to  its  value.  For  example,  if  the  random  number  generated  was 
.9999,  .9999  rimes  10,696  equals  10,967.9.  The  result  is  then  rounded  to  the  nearest 
whole  number  or  in  this  case  10,968.  If  a  value  of  one  were  not  added,  the  chance  to 
select  NSN  10,969  would  not  exist.  A  second  reason  for  adding  one  is  to  prevent  a 
random  number  firom  equaling  zero  since  the  value  of  zero  is  not  associated  with  a  NSN. 
For  these  reasons,  this  random  number  generation  process  provided  an  equaUy  probable 
chance  that  any  of  the  10,969  NSNs  could  be  selected  for  inclusion  in  the  sample  (20:1). 
As  a  result,  136  rank  positions  between  1  and  10,969  were  identified.  These  rank 
positions  were  used  to  select  the  corresponding  NSN  from  the  (XSSA  investment  item 
listing  obtained  from  SAMIS. 

Once  the  136  NSNs  were  selected,  the  following  additional  information  was 
extracted  from  the  SAMIS  database: 

1)  requisition  document  number 

2)  r^uisition  NSN 

3)  FMScase 

4}  requisition  quantity 

5)  unit  price  of  NSN 

6)  date  requisition  was  received  in  SAMIS 

7)  requisition  suffix  code 

8)  CLSSA  program/nonprogram  code 

9)  master  NSN  applicable  to  the  NSN  cited  in  requisition 

Analysis  of  the  sample  data  revealed  that  only  99  of  the  136  sample  NSNs 
possessed  valid  demand  history  that  could  be  used  for  forecasting  purposes.  Thirty-one  of 
the  sample  NSNs  (22.8  percent)  were  eliminated  because  they  had  zero  demands  over  the 
ten  year  period.  This  finding  is  consistent  with  previous  (XSSA  investment  item  analysis. 
Prior  analysis  found  that  approximately  36  percent  of  all  investment  NSNs  placed  on  the 
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CLSSA  program  have  never  been  ordered  (24:1).  Six  additional  NSNs  were  eliminated 
because  the  only  recorded  demands  resulted  from  customers  attempting  to  terminate  or 
reduce  their  previously  established  SLQ  using  drawdown  requisitions  requesting 
absorption.  Drawdown  requisitions  requesting  absorption  are  used  to  remove  unwanted 
items  and  quantities  from  a  participant's  SLQ.  Drawdown  requisitions  under  this 
condition  are  not  real  demands  by  a  customer  and  were  accordingly  excluded  from  the 
demand  history.  Drawdown  requisitions  requesting  the  items  be  shipped  to  the  participant 
were  treated  as  an  actual  demand  for  the  item.  This  left  99  NSNs  with  valid  demand  data 
that  could  be  used  to  test  the  forecasting  models.  Appendix  A  contains  a  list  of  the 
original  136  NSNs,  a  list  of  the  NSNs  Avith  zero  demands,  a  list  of  the  drawdown 
requisitions  removed,  and  a  list  of  the  remaining  99  NSNs  with  valid  denaands. 

The  histogram  in  Figure  2  identifies  the  demand  frequency  distribution  for  the 
remaining  99  NSNs.  Each  NSN  was  placed  into  one  of  three  demand  categories  based  on 
demand  activity.  Demand  activity  was  defined  as  the  cumulative  number  of  requisitions 
received  for  the  NSN  from  any  CXSS  A  customo*  during  the  ten  year  period.  The  low 
demand  category  consisted  of  NSNs  that  had  a  demand  frequency  of  just  one  or  two 
demands  over  the  ten  year  sample  period.  Thirty-five  NSNs  fell  in  the  low  demand 
category.  These  low  demand  NSNs  were  excluded  from  the  forecasting  comparison 
because  the  historical  demand  rates  (one  or  two  demands  in  ten  years)  reflect  a  lack  of 
recurring  demand.  The  stocklevel  should  only  include  NSNs  with  recurring  demands  (8:1- 
3).  The  CLSSA  program  does  not  requite  a  method  that  will  forecast  for  NSNs  with 
nonrecurring  demand.  The  only  test  performed  on  the  low  demand  category  concerned 
measuring  how  long  the  item  remained  on  the  stocklevel  case  before  the  model 
recommended  a  zero  forecast  This  analysis  was  only  conducted  against  the  AFSAC 
model  to  determine  if  the  logic  of  rounding  up,  to  a  stocklevel  of  one  for  any  value  above 
zero  and  less  than  one,  would  significantly  increase  the  stocklevel  value.  The  medium 
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demand  category  included  NSNs  with  a  demand  frequency  range  from  3  to  34  demands. 
Fifty-one  NSNs  fell  into  the  medium  demand  category.  The  high  demand  category 
included  NSNs  with  a  demand  frequency  range  from  35  to  210  demands.  Thirteen  NSNs 
fell  into  the  high  demand  category. 


Numbor  of  Oemondi 


Figure  2.  Histogram  of  Sample  Population 


Model  Sdection 

Previous  research  has  established  that  no  one  forecasting  method  works  best  in  all 
circumstances.  As  a  result,  forecast  must  select  the  technique  which  works  best  for 
their  particular  requirements  based  upon  the  presumed  patterns  in  the  data  (13:7-23). 
Based  (xi  the  information  examined  in  the  literature  review  concerning  various  forecasting 
methods,  three  traditional  forecasting  models  wen  selected  that  previous  research  had 
shown  to  be  the  most  accurate  in  responding  the  patterns  hypothesized  to  exist  in  CLSSA 
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historical  demand  data  (13:13).  A  fourth  model,  the  AFSAC  retention  formula,  was 
selected.  The  AFSAC  model  was  selected  to  measure  its  accuracy  in  comparison  to  other 
potential  CLSSA  forecasting  methods.  The  AFSAC  intends  to  implement  its  retention 
formula  in  October  1994.  As  such,  the  retendon  formula  serves  as  a  standard  to  measure 
the  performance  of  the  traditional  models. 

Using  the  times-series  criterion  alone  resulted  in  the  selection  of  the  double 
exponential  smoothing  model  (13:70-73;  14:79-80;  15:55-60).  Two  additional  models, 
the  adaptive  response  and  the  classical  decomposition  models  were  selected  based  on  their 
ability  to  enhance  a  time-series  forecast  using  underlying  trends,  cycles,  and  seasonality.  It 
was  anticipated  that  a  trend  would  exist  as  a  item  passed  through  its  life  cycle  (23:32). 
Cycles  and  seasonality  were  postulated  to  exist  due  to  disparities  in  the  FMS  customers' 
fiscal  year,  exercise  participation,  flying  hour  profiles,  and  holiday  seasons.  Analysis  and 
rationalization  of  these  trends,  cycles,  and  seasonality  factors  was  expected  to  lead  to 
more  acctirate  forecasts.  The  adaptive  response  model  excels  in  its  ability  to  identify  and 
effectively  resptmd  to  changes  in  underlying  data  patterns  (13:82-96;  14:266-274;  15:286- 
299).  The  classical  decomposition  model  excels  in  its  ability  to  separate  the  data  into  the 
individual  subparts  of  trend,  cycle,  and  seasonal  changes  (13:171-196;  14:383-387; 
15:328-361). 

Forecasting  Methods  Evaluated 

Four  forecasting  methodologies  were  evaluated  to  determine  which  method 
produced  the  most  accurate  forecast  of  CLSSA  reparable  item  demands.  These  methods 
consisted  of  the  three  traditional  and  one  unique  method  developed  by  the  AFSAC.  A 
description  of  the  forecasting  methods  evaluated  follows: 

Double  Exponential  Smoothing  -  This  method  in  concept  is  similar  to  the  double 
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moving  average  method.  In  this  method,  a  single  exponential  smoothed  value  is 
calculated.  Next,  a  double  exponential  smoothed  value  is  calculated  using  the  single 
exponential  smoothed  values  as  input.  The  difference  between  these  two  calculations  is 
added  back  to  the  single  smoothed  value  for  a  forecast  value.  Double  exponential 
smoothing  produces  more  accurate  results  than  single  exponendal  smoothing  when  trend 
patterns  exist  in  the  data.  Research  has  found  that  the  double  exponential  smoothing 
method  always  produces  more  accurate  results  than  the  double  moving  average  method 
(13:70-73;  14:79-80;  15:55-60). 

Classical  Decomposition  -  Most  time  series  methods  attempt  to  produce  forecasts 
by  accounting  for  the  cumulative  impacts  of  trend  factors,  cyclical  factors  and  seasonal 
factors.  The  decomposition  method  separates  the  overall  data  pattern  into  individual 
subparts  of  trend,  cycle  and  seasonal  elements.  This  method  can  be  used  to  explain 
fluctuations  in  data  values  and  permits  predictions  to  be  tailored  to  reflect  n^nd,  cycle  and 
seasonal  changes  (13:123-145;  14:198-209;  15:88-138). 

Adaptive  Response  -  This  method  uses  weighted  historical  data  to  forecast  future 
values.  The  value  of  the  weight  applied  to  each  historical  data  value  is  recalculated  for 
each  new  forecast  period.  The  amount  of  adjustment  to  the  weights  is  based  upon  the 
amount  of  error  that  occurred  between  the  previous  period's  forecast  value  and  actual 
value.  This  is  a  dynamic  method  where  the  weights  will  be  continuously  adjusted.  The 
adaptive  capability  of  this  method  permits  it  to  respond  effectively  to  changes  in  the 
patterns  of  the  underlying  data.  This  method  usually  produces  more  accurate  results  than 
the  moving  average  and  exponential  smoothing  methods;  especially  when  the  histtxical 
data  contains  a  complicated  underlying  pattern  (13:82-96;  14:266-274;  15:286-299). 

AFSAC  Retention  Formula  -  This  method  segments  the  four  year  demand  history 
of  each  CLSSA  investment  item  into  a  repair  (requisitions  containing  an  "H"  in  card 
column  40  of  the  FMS  requisition)  and  nonrepair  ctxnponent  The  algorithm  described 
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below  is  applied  to  each  of  the  demand  segments  (repair  and  nonrepair)  to  predict 
consolidated  future  demands.  On  the  first  day  of  each  quarter  the  model  examines  the 
past  four  year  period  (16  quarters)  for  recurring  demands  (requisitions  submitted  by  the 
FMS  customer  with  an  "R"  in  card  column  44).  These  demands  are  then  placed  into  their 
respective  16  quarters.  Weights  are  then  assigned  to  place  emphasis  on  the  most  recent 
data.  To  determine  a  weighted  quantity,  the  sum  of  each  quarterly  quantity  is  multiplied 
by  a  weighting  factor.  This  weighting  factor  starts  at  1(X)  percent,  and  is  reduced  by  6.25 
percent  each  time  a  zero  quantity  exists  for  a  quarterly  sum.  After  the  weighting  factor 
has  been  assigned  to  each  quarter,  the  actual  quarterly  demand  is  multiplied  times  the 
weighting  factor  to  arrive  at  a  weighted  quantiQ^.  All  sixteen  of  these  weighted  quantities 
are  summed  for  a  total  weighted  quantity. 

The  total  weighted  quantity  is  tiien  divided  by  the  number  of  years  involved  in  the 
accumulation  of  denumds.  The  number  of  years  involved  in  demand  accumulation  is 
determined  as  follows:  if  there  are  demands  in  quarters  13-16,  then  the  number  of  years 
equals  4,  and  the  total  weighted  quantity  should  be  divided  by  48  to  arrive  at  a  total 
monthly  demand  quantity.  If  all  the  demands  in  quarters  13-16  are  zero,  but  there  are 
demands  in  quarters  9  -12,  then  the  number  of  years  equals  3,  and  the  total  weighted 
quantity  should  be  divided  by  36  to  arrive  at  a  total  monthly  demand  quantity.  If  the 
demands  in  quarters  9-16  are  zero,  but  there  are  demands  in  quarters  5-8,  then  the  number 
of  years  equals  2,  and  the  total  weighted  quantity  should  be  divided  by  24  to  arrive  at  a 
total  monthly  demand  quantity.  Finally,  if  the  demands  in  quarters  5-16  are  zero,  tiien  the 
number  of  years  equals  1,  and  the  total  weighted  quantity  should  be  divided  by  12  to 
arrive  at  a  total  monthly  demand  quantity. 

For  noiuepair  demands,  the  stocklevel  quantity  is  the  monthly  demand  quantity 
times  the  lead  time  in  months.  For  repair  demands,  the  stocklevel  quantity  is  the  repair 
time  in  months  plus  a  six  month  additive  for  administrative  processing  time.  If  the  total 
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monthly  demand  value  is  less  than  one  for  either  the  repair  or  nonrepair  demand  segments, 
the  value  of  each  is  rounded  up  to  one.  All  other  values  less  than  .5  are  rounded  down 
and  values  of  .5  or  above  are  rounded  up  to  the  next  whole  number.  The  resultant  total 
monthly  demands  for  the  repair  and  nonrepair  components  are  then  summed.  The 
summed  value  is  than  multiplied  by  three  to  arrive  at  a  quarterly  value  for  forwaiding  to 
tile  item  manage  via  D041  (21:1). 

Demand  Segmentation 

Demand  for  each  NSN  is  a  combination  of  two  types  of  demand.  The  first  type 
demand  is  where  the  (XSS  A  customer  receives  a  serviceable  asset  in  exchange  for  a 
reparable  carcass,  referred  to  as  lepairAeplace  support  The  second  type  demand  is  for  an 
additional  item  without  exchanging  a  reparable,  referred  to  as  nrxuepair  support.  Thus, 
the  total  demand  for  each  NSN  was  segmented  into  three  categcries:  1)  combined 
repair/replace  and  nonrepair  demands,  2)  repair  demands  only,  and  3)  nonrepair  demands 
only.  This  segmentation  process  was  necessary  in  cmier  to  provide  an  equitable 
comparison  of  the  traditional  forecasting  methods  with  the  AFSAC  retention  formula. 

The  AFSAC  retention  formula  calculates  repair  support  demands  differently  than 
nonrepair  support  demands.  Repair  support  consists  of  demands  that  include  tiie  CLSSA 
customer  returning  a  reparable  carcass  to  a  US  depot  for  repair.  In  this  situation  the 
customer  receives  a  serviceable  asset  fitxn  US  depot  stock  in  a  relatively  short  period. 

Fot  this  thesis,  these  demands  are  called  H-coded’  demands  and  are  considered  to  have  an 
average  repair  time  of  9  months.  Nonrepair  support  consists  of  demands  where  no 
reparable  carcass  will  be  returned.  In  this  situation,  the  depot  replenishment  time  equates 
K>  the  procurement  lead  time  for  the  item.  These  lead  time  are  significantly  longer  that 
repair  replenishment.  For  this  thesis,  these  demands  are  called  'N-coded*  demands. 
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Nonrepair  item  forecasts  were  calculated  based  on  two  standardized  lead  times:  one  at  24 
months  to  reflect  an  item  that  has  a  shon  to  medium  lead  time  and  one  at  36  months  to 
reflect  an  item  with  a  medium  to  long  lead  time. 

Forecasting  Process 

Forecasts  were  produced  under  four  different  forecasting  horizons.  These 
horizons  were  for  1)  one  quaner,  2)  one  24  month  lead  time,  3)  one  36  month  lead  time 
and,  4)  one  9  month  lead  time.  The  one  quarter  forecast  was  intended  to  provide  an  initial 
performance  comparison  among  the  three  traditional  forecasting  methods.  The  24  month 
lead  time  forecast  was  selected  to  represent  the  forecasting  horizon  of  interest  for  a  short 
to  medium  lead  time  item.  The  36  month  lead  time  was  selected  to  represent  the 
forecasting  horizon  of  interest  for  a  medium  to  long  lead  time  item.  The  9  mtmth  lead 
time  was  seleaed  to  represent  the  forecasting  horizon  of  interest  equating  to  repair  lead 
time  item.  The  repair  lead  time  period  is  analogous  to  the  lead  time  experience  when  a 
CLSS  A  customer  returns  a  reparable  carcass  at  the  same  time  a  replacement  item  is 
detnanded. 

Results  of  the  forecasting  process  were  evaluated  at  9, 24,  and  36  months  because 
effective  forecasting  must  match  the  characteristics  of  the  situation  or  process  at  hand  with 
the  characteristics  of  the  forecasting  methodology  (13:33).  These  lead  times  represent  the 
fwecast  horizon  of  interest.  The  longer  the  forecast  horizon,  the  greater  probability  for 
error  (16:445).  Assessing  each  model  at  the  various  lead  times  measures  the  degree  of 
accuracy  deterioration.  An  investigative  question  was  to  determine  which  model  was  the 
most  accurate.  Overall  accuracy  is  a  function  of  the  model's  capability  to  produce 
accurate  forecasts  over  a  range  of  forecasting  horizons.  For  this  research,  forecasting 
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horizons  of  9, 24  and  36  months  were  selected  as  being  representative  of  various  CLSSA 
horizons. 


The  lead  time  of  an  item  is  important  to  the  CLSSA  program  because  it  determines 
the  length  of  the  forecasting  horizon.  The  CLSSA  stocklevel  quantity  should  represent 
the  quantity  of  items  that  should  be  in  inventory  to  support  recurring  demands  that  occur 
over  tile  lead  time  of  the  item.  The  longer  the  lead  time,  the  longer  the  forecast  horizon. 
Forecasting  methods  become  increasingly  inaccurate  as  the  forecasting  horizon  increases. 
Measuring  forecast  accuracy  for  various  lead  times  required  the  model  to  forecast  for 
various  time  horizons.  Any  CLSSA  forecasting  method  must  be  capable  of  accurately 
forecasting  across  a  range  of  lead  times.  A  metiiod  that  may  produce  extremely  accurate 
results  for  a  short  htnizon  may  produce  extremely  inaccurate  results  for  a  long  horizon. 
This  methodology  permitted  accuracy  measurement  to  be  assessed  based  on  performance 
across  a  range  of  horizons  ratiier  than  just  one  specific  horizon.  This  method  attempts  to 
reflect  the  actual  lead  time  variability  of  tiie  CLSSA  environmenL 

As  previously  stated,  the  demand  for  each  NSN  was  segmented  into  categories. 
This  categorization  permitted  analysis  of  each  of  tiie  forecasting  methods'  ability  to 
forecast  for  each  of  three  segments  of  CLSSA  demand.  The  first  category  represents  the 
cumulative  CLSSA  demand  for  the  particular  NSN.  This  category  combines  demand  both 
for  repair  support  as  indicated  by  H-coded  requisitions  and  for  nonrepair  support  as 
indicated  by  N-coded  requisitions. 

The  second  category  represented  H-coded  only  demands  for  the  NSN.  This 
category  represents  demands  that  were  submitted  in  accordance  with  repair/replace 
procedure.  These  types  of  demands  can  be  distinguished  by  a  TI"  in  the  requisition 
document  number.  These  types  of  demands  are  referred  to  as  "H-coded"  demands.  H- 
coded  requisitions  are  different  from  a  tegular  requisitions  in  that  the  customer  agrees  to 
return  a  reparattie  carcass  to  the  appropriate  US  depot  in  return  for  being  supplied  a 
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serviceable  item.  H-coded  demands  theoretically  have  a  shorter  lead  time  relating  to  the 
average  repair  time  for  the  item  versus  the  full  procurement  lead  time.  Because  of  this 
lead  time  difference,  each  forecasting  method's  ability  to  respond  to  this  distinct  type 
demand  pattern  was  tested. 

The  diird  segmentation  involved  aggregating  all  the  'regular*  demand  requisitions. 
This  category  referred  to  as  'N-coded  only'  demands  represents  all  demands  not  submitted 
under  the  repair/replace  program.  N-coded  demands  represent  requirements  for  material 
when  a  reparable  carcass  will  not  be  provided  to  the  US  depot  for  repair.  Material  must 
normally  be  procured  to  support  these  requirements. 

As  a  result  of  the  demand  segmentation  process,  three  data  streams  existed  for 
each  NSN.  These  data  streams  were  comprised  of  1)  the  cumulative  H-coded  and  N- 
coded  demands  for  the  NSN,  2)  only  the  H-coded  demands  for  the  NSN  and,  3)  only  the 
N-coded  demands  for  the  NSN.  Each  forecasting  model  was  examined  using  each  of 
these  data  streams  as  input. 

Forecasting  Software 

Forecasts  for  the  three  traditional  methods  (double  exponential,  adaptive  response 
and  classical  decorrrposition)  were  computed  using  the  SORTTEC  Sandler  II  Version 
6.4.035  forecasting  software  package  (26).  This  is  a  special  educaticmal  version  of  the 
SORTTEC  commercial  forecasting  package  that  is  used  by  many  well  known  financial 
institutions,  government  agencies,  public  utilities,  industrial  firms  and  academic  institutions 
(2S;viii).  The  key  difference  between  the  commercial  version  and  the  sampler  version  is 
that  the  sampler  version  does  not  include  the  full  complement  of  report  generation 
capabilities.  The  SORTTEC  Sampler  package  automatically  calculates  the  optimal 
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smoothing  value  of  alpha  for  exponential  smoothing,  beta  for  adaptive  response  and  the 
linear  trend  and  seasonal  indices  for  classical  decomposition. 

The  AFSAC  retention  formula  applies  a  complex  weighted  average  algorithm  to 
produce  CXSSA  forecasts.  Due  to  the  unique  and  elaborate  weighting  scheme  and  to 
increase  validity,  AFSAC  was  requested  to  produce  forecasts  for  the  sample  data  rather 
than  attempt  to  replicate  their  retention  formula  code.  AFSAC  graciously  agreed  to  run 
the  sample  data  through  their  algorithm  on  their  hardware. 

AFSACs  retention  formula  operates  on  16  quarters  of  the  most  recent  historical 
demand  history  for  each  NSN.  The  model  uses  this  data  to  forecast  one  lead  time  into  the 
future.  A  total  of  25  data  streams  consisting  of  16  sequential  quarters  could  be  generated 
from  the  sample's  40  quarters  of  data.  For  example,  the  first  data  stream  included 
demands  from  the  16  quarters  from  1984  quarmr  1  through  1988  quarter  4.  The  second 
data  stream  then  included  the  16  quarters  of  data  from  1984  quarter  2  through  1989 
quarter  1.  An  example  of  the  format  of  the  data  provide  AFSAC  is  in  Appendix  C. 

To  be  consistent  with  the  forecasting  process  established  for  the  three  traditional 
methods,  the  AFSAC  was  provided  with  three  different  aggregations  of  the  demand  data 
for  each  NSN.  The  first  aggregation  consisted  of  tiie  combined  H-coded  and  N-coded 
demands.  The  second  aggregation  grouped  the  H-coded  only  demands  and  the  third 
aggregation  provided  the  N-coded  only  demands.  This  approach,  like  that  for  the  other 
forecasting  methods,  permits  evaluation  of  the  model’s  accuracy  in  responding  to  three 
different  data  pattern  inputs. 

One  Quarter  into  the  Future 

A  one  quarter  into  the  future  forecast  was  accomplished  to  provide  an  initial 
evaluation  of  the  three  traditional  forecasting  methods  among  one  another.  The  AFSAC 
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retention  formula  could  not  be  used  in  this  comparison.  The  sample  data  was  segmented 
into  chronological  quarters  based  upon  the  date  that  each  individual  requisition  was 
received  by  SAMIS.  The  ten  years  of  sample  data  produced  40  quaners  of  demand  data. 
The  40  quarters  of  demand  data  were  further  segmented  into  three  categories  of  CLSSA 
demand.  As  a  result  of  the  segmentation  process,  three  data  streams  existed  for  each 
NSN.  These  data  streams  were  comprised  of  1)  the  cumulative  H-coded  and  N-coded 
demands  for  the  NSN,  2)  only  the  H-coded  demands  for  the  NSN,  and  3)  only  the  N- 
coded  demands  for  the  NSN.  Each  of  these  data  streams  for  each  NSN  in  the  sample 
were  provided  as  40  quaners  of  historical  input  data  to  each  of  the  three  tradidonai 
forecasting  models.  As  a  result,  each  method  produced  a  total  of  three  forecasts  for  each 
NSN.  Each  forecast  was  rounded  to  a  whole  number  using  standard  rounding  rules  of  .50 
or  greater  being  rounded  up  and  .49  or  less  being  rounded  down.  Forecasts  of  negadve 
values  were  rounded  to  zero. 

• 

Twenty«four  Month  Forecasts 

The  24  month  (8  quarters)  forecasts  were  accomplished  by  reaggregating  the  40 
quaners  of  historical  demand  data  into  24  month  units.  This  reaggregation  could  have 
been  in  any  unit  period.  However,  aggregaa..ig  the  data  into  input  units  that  correspond  to 
the  forecast  horizon  simplifies  the  forecast  process.  By  providing  data  inputs  in  the  same 
unit  period  as  the  forecast  horizon,  the  forecasting  models  simply  produce  a  forecast  for 
one  period  into  the  future.  No  conversion  of  model  output  is  required  to  generate  a 
prediction  for  the  forecast  horizon.  For  example,  if  quarterly  data  was  used  as  input,  the 
output  would  also  be  in  units  of  quarters.  This  output  would  require  an  arithmetic  process 
to  generate  a  forecast  for  the  24  month  period  of  interest.  An  example  of  a  24  month  lead 
time  forecast  input  is  located  in  Appendix  C. 
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The  40  quarters  of  historical  data  convertwi  to  33  values.  Each  value  represented 
the  cumulative  demand  for  an  individual  24  month  period.  These  33  units  of  demand  data 
were  input  to  each  of  the  traditional  forecasting  models.  The  AFSAC  retention  formula, 
regardless  of  the  forecasting  horizon,  required  16  quarters  of  historical  data  to  initialize 
prior  to  producing  its  first  forecast.  The  double  and  single  exponential  models  required 
one  demand  value  to  initialize  before  providing  the  first  forecast  value. 

One  lead  time  of  actual  historical  demand  had  to  be  reserved  to  measure  the 
accuracy  of  the  final  forecast.  For  the  24  month  forecasts,  the  final  8  quarters  of  data 
(1992  quarter  1  through  1993  quaner  4)  were  reserved  for  accuracy  measurement.  As  a 
result  of  the  initialization  and  accuracy  reserve  data  requirements,  a  maximum  of  17 
measurable  observations  were  possible  for  the  AFSAC  retention  formula. 

The  24  month  comparable  forecast  horizon  was  limited  by  the  AFSAC  model 
which  could  only  forecast  a  maximum  of  17  lead  time  periods  fix)m  1988  quaner  1 
through  1991  quarter  4.  For  each  forecasting  method,  an  average  MSE  was  computed  by 
summing  the  MSE  values  from  each  NSN  forecast  and  then  dividing  by  the  number  of 
NSNs  that  the  method  could  produce  a  forecast  For  example,  if  a  forecasting  method 
could  produce  a  forecast  for  63  of  the  64  sample  NSNs,  the  MSE  values  fi'om  each  of  the 
63  forecasts  would  be  summed  and  then  divided  by  63  to  yield  an  average  MSE  for  that 
forecasting  method.  In  order  to  fairly  compare  the  traditional  forecasting  methods' 
performance  to  the  AFSAC  method's  performance,  the  results  fiom  the  same  forecast 
periods  must  be  measured.  The  MSE  comparison  results  are  from  AFSACs  maximum 
measurable  17  periods. 
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Thirty-six  Month  Forecasts 


The  36  month  (12  quarters)  forecast  was  accomplished  by  reaggregating  the  40 
quarters  of  historical  demand  data  into  36  month  units.  An  example  of  a  36  month  lead 
time  forecast  input  is  located  in  Appendix  C.  The  40  quarters  of  historical  data  converted 
to  29  units  of  individual  36  month  demand  values.  These  29  units  of  demand  data  were 
input  to  each  of  the  traditional  forecasting  models. 

The  AFSAC  retention  formula,  regardless  of  the  forecasting  horizon,  requires  16 
quarters  of  historical  data  prior  to  producing  its  first  forecast  One  lead  time  of  actual 
historical  demand  had  to  be  reserved  to  measure  the  accuracy  of  the  final  forecast  For  the 
36  month  forecasts,  the  rinal  12  quarters  of  data  (1991  quarrer  1  through  1993  quarter  4) 
had  to  be  reserved  for  accuracy  measurement  As  a  result  of  the  initialization  and 
acctnacy  reserve  data  requirements,  a  maximum  of  13  measurable  observations  were 
possible  for  die  AFSAC  retention  formula. 

In  order  to  fairly  compare  the  traditional  forecasting  methods'  performance  to  the 
AFSAC  method's  performance,  the  results  from  the  same  forecast  periods  must  be 
measured.  The  MSB  comparison  results  among  all  models  are  based  on  AFSAC's 
maximum  measurable  13  periods  running  from  1988  quarter  1  through  1990  quaner  4. 

The  same  MSB  averaging  process  used  for  the  24  month  forecasts  was  used  for  the  36 
month  forecasts. 

Nine  Month  Forecasts 

The  9  mtxith  (3  quarters)  forecast  was  accomplished  by  reaggregating  the  40 
quarters  of  historical  demand  data  into  9  month  units.  An  example  of  a  9  month  lead  time 
forecast  output  is  located  in  Appendix  D.  The  40  quarters  of  historical  data  converted  to 
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38  units  of  individual  36  month  demand  values.  These  38  units  of  demand  data  were  input 
to  each  of  the  traditional  forecasting  models. 

The  AFSAC  retention  formula,  regardless  of  the  fraecasting  horizon,  requires  16 
quarters  of  historical  data  prior  to  producing  its  first  forecast  One  lead  time  of  actual 
historical  demand  had  to  be  reserved  to  measure  the  accuracy  of  the  final  forecast  For  the 
9  month  forecasts,  the  final  3  quarters  of  data  (1993  quarter  2  dirough  1993  quaner  4) 
were  reserved  for  accuracy  measurement  As  a  result  of  the  initialization  and  accuracy 
reserve  data  requirements,  a  maximum  of  22  measurable  observations  were  possible  for 
the  AFSAC  retention  formula.. 

Again,  in  order  to  fairly  compare  the  traditional  forecasting  methods'  performance 
to  the  AFSAC  method's  performance,  the  results  from  the  same  forecast  periods  must  be 
measured.  Therefore,  the  MSB  comparison  results  are  fixxn  AFSACs  maximum 
measurable  22  periods  running  fix>m  1988  quar^  1  through  1993  quarter  1.  The  same 
MSB  averaging  process  used  for  the  24  month  and  36  month  forecasts  was  again  used  for 
the  9  month  forecasts. 

Performance  Measurements 

Because  of  the  inherent  inability  of  any  model  to  produce  a  completely  accurate 
forecast,  a  quantitative  process  must  be  used  to  evaluate  the  degree  of  accuracy  achieved 
by  each  forecasting  method.  The  forecasting  model  that  produces  the  smallest  forecast 
error  over  the  range  of  sample  data  was  selected  as  the  'best'  model.  Forecast  error  is  the 
difference  between  the  observed  historical  value  and  the  predicted  forecast  value.  If  the 
individual  forecast  errors  are  random,  as  they  should  be  if  the  choice  of  the  forecasting 
method  is  appropriate,  some  errors  will  be  positive  and  some  errors  will  be  negative. 
Simply  summing  each  individual  error  would  then  result  in  an  error  sum  near  zero. 
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Squaring  the  individual  forecast  errors  then  averaging  these  squared  errors  over  the 
number  of  observations  avoids  this  problem.  This  average  of  the  squared  errors  is 
commonly  referred  to  as  the  mean  squared  error  (MSE).  The  forecasting  method  which 
produced  the  smallest  MSE  is  considered  to  be  the  most  accurate. 

The  mean  percentage  of  error  (MAPE)  could  not  be  used  as  a  performance 
measure  for  this  data.  The  MAPE  is  the  percentage  that  results  from  dividing  the  absolute 
error  from  the  forecast  by  the  actual  value  that  subsequently  occurred  for  that  same 
period.  The  sample  data  frequently  had  zeros  as  the  actual  values.  MAPE  would  have 
required  division  by  zero  in  these  instances  which  is  not  possible. 

In  order  to  provide  some  perspective  of  each  method's  performance  in  terms  of 
actual  number  of  items  of  error,  the  square  root  of  the  MSE  is  presented.  The  square  root 
of  the  MSE  serves  to  translate  the  MSE  into  a  more  inmidvely  understood  measurement. 

The  most  relevant  categories  to  compare  accuracy  are  the  N-coded  24  and  36 
month  categories  and  the  9  month  H-coded  categories.  The  reasons  these  are  considered 
to  be  the  most  relevant  measurement  categories  are  1)  the  new  CLSSA  program  will  use 
separate  H-coded  and  N-coded  forecasts  to  compute  smcklevels,  therefore,  the  combined 
categories  are  not  relevant  measures,  2)  N-coded  requirements  have  longer  lead  times 
relating  to  the  74  and  36  month  measurements,  and  3)  the  H-coded  requirements  have 
shorter  lead  times  relating  to  the  9  month  measurements. 

Cost  Measurements 

Since  forecasting  is  concerned  with  predicting  the  demand  for  a  specific  item  based 
on  the  historical  demand  patterns  without  regard  the  cost  of  the  demand,  a  direct 
relationship  between  model  performance  and  cost  could  not  be  established.  Three 
measuranents  were  used  to  answer  the  investigative  question  regarding  the  financial 
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impact  of  each  model's  performance  on  the  value  of  the  FMSO I  case.  These  three 
financial  measurements  ranged  from  a  generalized  to  a  specific  measuremenL 

The  first  and  most  generalized  financial  measurement  simply  takes  the  total  value 
of  all  the  demands  divided  by  the  total  number  of  demands  to  arrive  at  an  average  value 
per  item.  This  average  value  per  item  was  multiplied  by  the  quantity  of  items  predicted  by 
each  model  to  generate  a  FMSO  1  value  associated  with  each  iiKxiel. 

The  second  financial  measurement  calculated  an  average  value  for  each  item  within 
the  low,  medium,  and  high  category.  To  detemune  the  average  value  by  category  a  total 
demand  value  was  calculated  for  each  NSN,  these  values  were  summed  based  on  the  NSN 
category,  and  then  divided  by  the  total  number  of  demands  within  the  category.  The  result 
was  an  average  value  for  each  item  within  a  demand  category.  This  average  category 
value  was  used  to  assess  which  model  categmy  attributed  the  most  financial  impact  on  the 
FMSO  I  value. 

The  third  and  most  specific  financial  measurement  was  calculated  by  taking  the 
total  value  of  all  the  demands  for  a  particular  NSN  divided  by  the  number  of  demands 
received  to  arrive  at  an  average  cost  per  NSN.  The  average  cost  per  NSN  was  multiplied 
by  the  forecast  quantities  to  arrive  at  a  new  FMSO  I  value.  At  the  latest  date  where  all 
models  could  generate  a  forecast,  the  cost  performance  measurements  were  compared  to 
the  actual  demands  and  the  current  FMSO  I  value  to  determine  the  financial  impact  each 
noodel  had  on  the  FMSO  I  case. 

Validity 

The  sample  data  consisted  of  actual  historical  CLSSA  demands  placed  over  a  ten 
year  period.  Given  that  the  final  usable  saiiqrle  size  was  large  (99  NSNs),  it  was 
appropriate  to  assume  that  the  data  display  typical  demand  patterns  that  are  present  in  the 
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population.  The  methodology  examines  how  each  of  four  forecasting  methods  performs 
on  these  various  data  patterns.  The  age  of  the  sample  data  would  not  be  a  significant 
factor  that  influences  the  results,  since,  the  low,  medium  and  high  demand  categories 
permitted  the  use  of  potentially  outdated  data  to  make  generalizations  on  current  demand 
trends  because  all  demand  rates  for  CLSSA  NSNs  will  fall  into  one  of  these  categories. 
NSNs  may  over  time  change  from  one  demand  category  to  another  throughout  the  item's 
life  cycle.  Therefore,  if  a  large  sample  of  historical  NSN  demand  data  can  be  used  to 
develop  accurate  forecasting  methods  for  each  demand  category,  then  these  same  forecast 
methods  should  be  accurate  for  future  demands  in  the  same  category  regardless  of  the 
particular  item. 

The  SORTTEC  software  package  was  used  to  compute  the  forecasts  for  the  three 
traditional  methods  (26).  The  forecasting  algorithm  code  within  this  software  has  been 
tested  and  can  be  considered  reliable.  The  AFS  AC  forecasts  were  computed  using  the 
actual  algorithms  and  hardware  that  will  be  used  for  actual  CLSSA  processing  as  of 
1  October  1994.  The  use  of  these  sources  for  calculating  the  forecasts  contributes  to  the 
validity  of  the  results. 

Study  Limitations 

The  results  of  this  research  are  limited  in  use  to  the  current  mix  of  FMS  customers 
and  the  weapon  systems  being  supported.  The  budget  constraints  being  experienced  in  the 
foreign  governments  may  result  in  reduced  operational  requirements  and  effect  the  results 
of  the  forecasting  models.  Modifications  to  the  forecasting  model  may  be  required  as  the 
FMS  customers'  mix  of  weapons  systems  supported  evolve. 
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Overview 


lY,  Results  and  Analysis 


Tliis  chapter  contains  the  results  obtained  from  the  methodology  described  in 
Cluster  Three.  The  results  are  discussed  based  upon  chronological  progression  of  the 
research.  This  section  begins  with  a  discussion  of  the  results  obtained  when  forecasting 
just  one  quarter  into  the  future.  These  results  lead  to  a  redefinition  of  the  fcnecasting 
horizon.  Difficulties  encountered  in  the  one  quarter  into  the  future  forecast  generated 
revisions  to  the  original  methodology.  Rationale  for  revising  the  methodology  is 
described.  Next,  the  results  obtained  for  the  24, 36,  and  9  month  forecasts  produced 
under  the  revised  methodology  are  presented.  Finally,  an  analysis  of  the  results  is 
provided  by  providing  answers  to  each  of  the  investigative  questions  based  upon  the 
results  achieved  from  this  research. 

One  Quarter  into  the  Future  Forecast 

The  objective  of  this  initial  comparison  was  to  produce  a  summary  assessment  of 
the  three  tradititxial  models'  (double  exponential,  adaptive  response,  classical 
decomposition)  ability  to  perftmn  when  provitted  40  quarters  of  actual  CLSSA  demand 
histmy  as  input  The  AFS  AC  retention  formula  was  not  used  in  this  initial  comparison. 
Each  traditional  method  computed  forecasts  using  the  same  40  quarters  of  input  data.  In 
this  process,  each  model  could  use  actual  quarter  1  daut  to  forecast  for  quarter  2  demand, 
then  use  actual  quarters  1  and  2  to  forecast  for  quaner  3.  This  process  continued  so  that 
for  the  final  quarter,  the  program  could  use  actual  data  from  quartors  1  through  39  to 
forecast  quarter  40  demand.  The  results  exannned  which  of  die  diree  traditional  methods 
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would  produce  the  most  accurate  result  as  measured  by  their  respective  mean  squared 
error  (MSE). 

The  results  of  the  one  quarter  into  the  future  forecasts  are  provided  in  Appendix 
D.  The  abbreviation  "No  Comp."  means  that  tiie  SORTTEC  software  was  unable  to  arrive 
at  an  optimal  smoothing  value  for  alpha  or  beta  based  upon  the  time-series  data  provided 
as  input  As  a  result,  a  forecast  could  not  be  generated. 

Table  1  presents  a  summary  of  the  cumulative  MSE  for  each  NSN  in  each  of  the 
three  denuuid  categories  (Total  H  &  N  Coded  Combined,  H-Coded  Only,  N-Coded  Only). 
The  double  exponential  method  produced  forecasts  for  80  percent  of  the  combined 
denuinds,  60  percent  of  the  H-coded  only  demands  and  80  percent  of  the  N-coded  only 
demands.  The  ad{q)tive  response  naodel  performed  much  worse.  This  noodel  could  only 
produce  forecasts  for  37  percent  of  the  combined  demand,  26  percent  of  the  H-coded  only 
demand  and  21  percent  of  the  N-coded  only  demand.  The  inability  of  the  software  to 
identify  a  optimal  smoothing  value  using  either  double  exponential  w  adaptive  response 
methods  would  be  a  significant  hindrance  to  irr^lementing  either  of  these  two  methods. 

Based  upon  this  poor  performance,  the  adaptive  response  was  eliminated  from 
furtiier  consideration  and  testing.  Its  inadequacy  to  consistently  provide  forecasts  make  it 
impractical  for  actual  application  regardless  of  the  degree  of  accuracy  achieved.  Curstny 
analysis  suggests  that  erratic  demand  spiking  caused  the  software's  algorithm  to  be  unable 
to  compute  an  optimal  smoothing  value  for  the  ad^tive  response  method.  This  finding  is 
consistent  with  the  literature  review  which  states  that  the  adaptive  response  method  does 
not  p^orm  well  when  there  is  significant  seasonality  in  the  data.  Although  irregular,  the 
spikes  that  appear  in  the  data  are  similar  to  seasonal  spikes.  The  double  exponential 
method,  although  performing  much  more  consistently,  would  also  require  an  additional 
forecasting  method  to  produce  a  default  forecast  when  the  double  exponential  method 
could  not  compute  one. 
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TABLE  1 

One  Quarter  Into  the  Future  Forecasts 
HftN  Coded  Combined  H>Coded  Only  N-Coded  Only 


Double 

Adaptive 

De¬ 

Double 

Adaptive 

De- 

Double 

Adaptive 

De- 

Exp. 

Rate  Exp. 

comp 

Exp. 

Rote  Exp.  comp 

Exp. 

Rote  Exp.  comp 

Smooth 

Smooth 

Smooth 

MSE  Sum 

2795.1 

2325.7 

1580.8 

253.5 

1341.99 

219.30 

2856.42 

1584.33 

1154.9 

Observations 

52.00 

24.00 

65.00 

39.0 

17.00 

65.00 

52.00 

14.00 

65.00 

Average  MSE 

53.75 

96.90 

24.32 

6.5 

78.94 

3.37 

54.93 

113.17 

17.77 

Pet  Function 

0.80 

0.37 

1.00 

0.60 

0.26 

1.00 

0.80 

0.22 

1.00 

The  classical  decomposition  model  cleaiiy  performed  the  best  of  the  three 
traditional  methods.  Its  MSE  was  the  least  for  each  of  the  three  demand  categories  and  it 
peifonned  100  percent  of  the  time.  The  forecasts  produced  by  this  method  were  based 
upon  a  SORTTEC  computed  trend  line  ai^  seasonal  index  facmr  calculated  from  the 
historical  data.  However,  the  cyclical  compcment  of  the  forecast  could  not  be 
automatically  computed  by  SORTTEC.  SORTTEC  requires  external  input  for  cyclical 
factcvs  across  the  forecast  horizon.  For  the  purposes  of  this  research,  a  judgmental 
forecast  of  the  cyclical  component  value  was  used  in  cmnputing  the  next  quarter's 
forecast  The  judgmental  forecast  was  derived  from  gnq>hical  review  of  the  trend  factors 
and  of  the  historical  cyclical  component  line.  Based  upon  this  method's  performance  in  the 
one  quarter  forecast  it  was  selected  for  further  analysis  and  testing  against  the  AFSAC 
retention  formula. 


Limitations  to  the  One  Quarter  Forecast 


Initial  forecasts  one  quarter  into  the  future  provided  valuable  information; 
however,  they  did  not  address  the  ability  of  the  methods  to  accurately  forecast  demand  for 
the  horizon  required  by  the  CLSSA  program.  The  CLSSA  program  needs  forecasts  of 


48 


future  demands  in  order  to  establish  stocklevels  for  each  NSN.  A  stocklevel  represents 
the  quantity  of  an  item  that  must  be  available  to  meet  demands  that  occur  between  the 
point  in  time  when  stock  replenishment  action  is  initiated  and  the  point  in  time  when  the 
replenishment  material  is  delivered  to  the  depot  The  length  of  this  period  of  time, 
referred  to  as  lead  time,  will  vary  for  each  individual  NSN.  To  provide  effective  CLSSA 
support  and  to  control  CLSSA  inventory  investment  costs,  a  forecast  of  the  demand  that 
will  occur  over  this  future  lead  time  period  is  required.  Action  to  adjust  the  on-hand  or 
on-order  materiel  will  be  taken  dependent  upon  the  forecast  If  the  forecast  predicts 
demand  during  the  lead  time  to  be  greater  that  the  current  stocklevel,  action  to  procure 
additional  materiel  will  be  required.  If  the  forecast  predicts  demand  during  the  lead  time 
to  be  less  than  the  current  stocklevel,  action  will  be  taken  to  liquidate  the  excess  portion  to 
the  stocklevel. 

The  research  tested  the  forecasting  methods'  accuracy  in  predicting  demand  over 
standardized  lead  times.  The  combined  H  &  N  coded  category  and  the  N-coded  only 
category  were  examined  at  two  lead  times;  one  at  24  months  (8  quarters)  and  the  other  at 
36  months  (12  quarters).  The  lead  times  were  selected  to  represent  items  with  a  short  to 
medium  lead  time  (24  months)  and  a  medium  to  long  lead  time  (36  months).  The  H-coded 
only  items  were  examined  at  one  lead  time  of  9  months  (3  quaners).  This  lead  time 
represents  the  period  of  time  required  to  obtain  replenishment  material  fipom  repair  sources 
versus  new  procurement 

Forecasting  for  One  Lead  Time 

Given  the  positive  performance  of  the  decomposition  method  in  predicting  one 
quarter  into  the  future,  similar  results  were  anticipated  using  standardized  lead  times. 
Although  very  accurate  when  predicting  one  quarter  into  the  future,  the  decomposition 
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method's  peiformance  was  significantly  different  when  attempting  to  make  a  prediction  for 
a  9, 24  or  36  month  lead  time  period.  For  the  decomposition  forecasting  procedure, 
SORTTEC  was  provided  16  quarters  (4  years)  of  historical  data  for  initialization  and 
establishment  of  a  linear  trend  line  and  seasonal  index.  A  sixteen  quarto'  of  initialization 
period  was  selected  because  it  equates  to  the  same  initialization  period  used  by  the 
AFSAC  retention  formula.  Again,  the  SORTTEC  program  required  external  inputs  of  the 
cyclical  component  factors.  Attempts  to  make  these  judgmental  forecasts  for  the  cyclical 
component  9, 24  or  36  months  into  the  future  proved  to  be  quite  tedious  and  time 
consuming.  The  cyclical  component  of  the  decomposition  model  was  subsequently 
eliminated  because  the  underlying  causal  factors  for  the  cycle  could  not  be  identified. 
Unless  an  automated  process  could  be  identified  to  calculate  a  cyclical  component  factor 
for  each  NSN,  the  use  of  a  cyclical  factor  in  forecasting  across  the  population  of  10,969 
O-SSA  NSNs  is  inq)ractical. 

Following  the  elimination  of  the  cyclical  component,  the  decomposition  forecast 
consisted  of  a  trend  component  and  a  seasonal  index  component  The  decomposition 
method  computed  a  trend  line  that  incorporated  inputs  from  all  demands  that  appeared  in 
the  16  quarters  of  historical  initialization  data.  Erratic  demand  spiking  frequently  caused 
the  trend  line  slope  to  be  inappropriately  skewed.  For  example,  if  a  NSN’s  ten  year 
demand  pattern  had  the  majority  of  quarterly  demand  in  the  range  of  1  to  10  but  also  had  a 
few  quarters  early  in  the  ten  years  with  demands  of  100,  a  negative  slope  would  be 
calculated  when  in  actuality  the  overall  demand  was  fairly  stationary.  Once  the  slope  of 
the  trend  line  was  calculated,  the  SORTTEC  program  projected  that  same  slope  over  the 
specified  number  of  periods  into  the  future.  Fot  decreasing  slopes,  the  trend  line  would 
frequently  cross  the  zero  value  on  the  x-axis  after  just  4  to  6  quarters  into  the  future.  The 
trend  line  would  ccmtinue  into  the  negative  region  for  the  balance  of  the  forecast  period. 
This  resulted  in  trend  components  being  computed  as  large  negative  values.  The  reverse 
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of  this  condition  occurred  when  the  large  quantity  spiking  had  transpired  latter  in  the 
demand  pattern.  In  this  situation,  a  positive  trend  line  would  continue  to  grow  at  a 
constant  rate  over  the  entire  forecasting  horizon.  The  trend  component  value  for  the  latter 
periods  of  the  forecast  horizon  became  relatively  large  compared  to  the  values  from  the  16 
quarters  of  historical  iiutialization  data. 

The  problems  encountered  with  the  trend  line  were  further  compounded  by  the 
seasonal  index  component.  The  intent  of  the  seasonal  index  is  to  either  inflate  or  deflate 
the  forecasted  values  to  correspond  to  historical  seasonal  fluctuations  in  demand. 

Seasonal  index  weights  are  used  as  an  adjusting  factor  to  the  underlying  forecast  value. 
Application  of  the  weight  presumes  that  the  underlying  forecast  value  is  correct  within  the 
required  limits.  The  analysis  identified  that  the  trend  component  of  the  forecast  was 
generally  grossly  erroneous,  the  seasonal  index,  when  greater  than  one,  further  increased 
the  magnitude  of  the  forecast  error. 

No  consistent  seasonal  index  pattern  occurred.  Each  NSN  had  a  unique  index  that 
reflected  the  peculiarity  of  the  particular  historical  demand.  This  feature  of  the 
decoo^osition  model  would  be  useful,  if  the  forecast  horizon  period  were  to  focus  on 
some  quarterly  subset  of  a  year.  However,  if  the  forecasting  horizon  extends  across 
multiple  years,  the  benefit  of  producing  seasonally  adjusted  quarterly  forecasts  is  basically 
negated.  The  negation  results  because  the  seasonal  weights  applied  within  any  one  year 
always  sum  to  four.  In  this  situation,  the  increasing  weight  tqjplied  to  a  particular  quarto: 
is,  in  part,  canceled  out  by  the  decreasing  weight  applied  to  a  different  quarter  within  the 
saiiM  year.  The  forecasting  horizon  extended  across  multiple  units  of  whole  years,  two 
years  for  the  24  month  standardized  lead  time  and  three  years  for  the  36  month 
standardized  lead  time.  In  this  situation,  the  seasonal  index,  even  if  applied  to  a  valid 
underlying  forecast,  was  of  little  practical  benefit 
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Gross  inaccuracies  of  the  decomposition  model  can  be  attributed  to  a  constant 
trend  line  being  forced  upon  data  that  did  not  possess  a  trend.  As  illustrated  in  Appendix 
B,  the  majority  of  the  data  does  not  exhibit  trend  patterns.  Due  to  the  inaccuracies  and 
inability  of  the  model  to  identify  the  causal  factors  necessary  to  utilize  the  cyclical 
conqmnent,  the  decomposition  method  was  eliminated  from  further  consideration  and 
testing. 

Rationale  for  Revised  Methodology 

Based  upon  the  disappointing  experience  with  both  the  adaptive  response  method 
(inability  to  forecast  from  the  demand  pattern)  and  the  decomposition  method  (inability  to 
use  the  cyclical  con^nent  and  gross  inaccuracies),  the  original  methodology  was  revised. 
Given  the  failure  of  two  of  the  three  initial  traditicmal  models,  four  additional,  simplistic 
traditional  methods  were  selected  for  testing  along  with  double  exponential  smoothing  and 
the  AFS  AC  retention  formula.  The  four  additional  traditional  methods  were  single 
exponential  smoothing,  a  two  lead  time  moving  average,  a  three  lead  time  moving  average 
and  a  four  lead  time  moving  average.  These  additional  models  were  selected  because  their 
simplistic  calculation  approach  presented  a  high  probability  that  the  SORTTEC  program 
would  produce  forecasts  in  spite  of  the  demand  spikes.  The  intent  in  testing  additional 
methods  was  to  provide  a  range  of  forecasts  results  to  compare  against  double  exponential 
smoothing  and  tiie  AFS  AC  retention  formula. 

Additionally,  it  was  decided  to  reaggregate  the  demand  data  provided  to  each 
model.  Under  the  revised  methodology,  each  traditional  model  was  provided  historical 
demand  data  based  in  units  of  lead  time  rather  than  in  historical  chronological  quarters. 
Reaggregating  the  input  into  lead  time  units  of  data  was  intended  to  smooth  out  the  erratic 
spiking  within  the  quarterly  demand  patterns.  A  NSN  using  the  standardized  24  month 
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lead  time  had  the  quarterly  demands  revised  to  comprise  moving  summations  of  8  quarters 
(24  months)  of  data.  For  example,  if  a  NSN  had  demands  of  5  for  each  of  the  first  8 
quarters,  the  model  was  provided  the  single  value  of  40  rather  than  the  eight  individual 
values  of  S.  The  tive  traditional  forecasting  methods  woe  exercised  using  historical  data 
aggregated  on  the  basis  of  lead  time  to  predict  just  one  lead  time  period  (9, 24,  or  36 
months)  into  the  future. 

The  intention  of  this  new  method  was  to  increase  forecast  accuracy.  This 
procedure  would  result  in  each  model  forecasting  only  one  period  into  the  future. 

Because  each  model  would  be  using  demand  data  in  the  same  units  as  the  forecast 
horizon,  it  was  anticipated  that  this  approach  would  prevent  the  models  from 
inappropriately  focusing  on  short  term  quanerly  changes  in  the  data.  This  research  was 
not  interested  in  generating  forecasts  that  would  following  the  radical  changes  between 
quarters.  Instead,  it  was  interested  in  forecasting  the  cumulative  demand  over  an  entire 
lead  time  period.  Furthermore,  the  literature  review  repeatedly  stated  that  forecasts 
become  progressively  more  inaccurate  over  a  longer  periods  into  the  future.  The  initial 
forecast  approach  was  attempting  to  forecast  multiple  quarters  into  the  future:  for 
example,  8  quaners  for  the  24  month  standardized  lead  time  and  12  quarters  for  the  36 
month  standardized  lead  time.  Using  the  new  approach,  the  forecast  was  only  necessary 
for  one  period  into  the  future. 

Accuracy  Measurement 

The  accuracy  of  each  model  was  measured  for  each  of  the  13  NSNs  in  the  'high' 
demand  category  and  SI  NSNs  in  the  'medium'  category.  The  accuracy  was  measured  by 
summing  the  value  of  the  MSE  for  each  measurable  observation  produced  by  the  given 
forecasting  model  An  average  MSE  was  then  calculated  for  each  NSN  by  dividing  the 
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sum  of  the  individual  MSE  values  by  the  number  of  measiuable  observations  for  the 
particular  NSN.  An  average  MSE  for  the  forecasting  method  was  calculated  by  summing 
the  average  NSN  MSE  and  dividing  by  the  number  of  NSNs.  The  average  MSE  for  each 
forecasting  method  provided  a  general  indication  of  each  method's  accuracy. 

However,  when  comparing  competing  models,  the  average  MSE  was  adjusted  to 
correspond  to  the  model  with  the  lowest  number  of  measurable  observations.  In  each  of 
the  forecasting  horizons  (24, 36  and  9  months),  the  AFSAC  retention  formula  produced 
the  least  number  of  measurable  forecasts.  Therefore,  the  accuracy  of  all  models  was 
compared  based  upon  the  AFS  ACs  maximum  forecasting  horizon  capabilities.  For  the  24 
month  forecasts,  comparisons  were  based  on  the  17  periods  from  1987  quarter  4  to  1991 
quarter  4.  For  the  36  month  forecasts,  comparisons  were  based  on  the  13  periods  from 
1987  quarter  4  to  1990  quaner  4.  The  9  month  comparisons  were  based  on  22  periods 
from  1987quarter  4  to  1993  quarter  1. 

Twenty-four  Month  Forecasts 

For  the  24  month  combined  H  and  N-coded  forecasts,  the  SORTTEC  program  was 
unable  to  prcxluce  a  forecast  for  1  of  the  64  NSNs  using  both  the  double  and  single 
expcmential  methods.  The  results  of  the  combined  H  and  N-code  forecasts  are  presented 
in  Table  2.  The  range  of  forecast  error  for  the  combined  H  and  N-coded  forecasts  runs 
from  AFS  ACs  retention  formula  being  the  'best'  at  a  MSE  of  658.49  to  double 
exponential  smoothing  being  the  'worsf  at  a  MSE  of  825.78.  The  real  magnitude  of  the 
difference  when  compared  in  whole  units  of  items,  by  rounding  the  square  root  of  the 
MSE,  becomes  +/-  26  items  for  the  AFSAC  retention  formula  and  +/-  29  items  for  the 
double  exponential  formula.  The  four  period  moving  average  method  was  a  close  second 
being  just  three  percent  less  accurate  than  the  AFSAC  retention  fOTmula. 
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TABLE  2 

Comparison  of  Combined  H  &  N  Code  24-Month  Forecasts 


Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2 

Average  3 

Average  4 

Method 

MSE  Sum 

52024.18 

47138.94 

46045.71 

44936.94 

43546.00 

42143.70 

Observations 

63.00 

63.00 

64.00 

64.00 

64.00 

64.00 

Average  MSE 

825.78 

748.24 

719.46 

702.14 

680.41 

658.50 

Sq.  Root  MSE 

28.74 

27.35 

26.82 

26.50 

26.08 

25.66 

Analysis  of  the  MSE  by  individual  NSN  identified  that  the  majority  of  the  error 
could  be  attributed  to  jus'  a  >w  items.  Five  items,  NSNs  H3,  H6,  H9,  HIO,  and  M51, 
cumulatively  produce  be  veen  70  to  84  percent  of  the  total  error  for  each  of  the 
forecasting  models.  Table  3  shows  this  comparison.  NSNs  H3,  H6,  H9,  HIO,  and  M51 
represent  demand  patterns  that  none  of  the  methods  were  capable  of  responding  to  well. 
The  data  pattern  for  these  items  is  provided  in  Appendix  B.  With  these  large  sources  of 
error  removed,  die  AFS  AC  retention  formula  and  the  double  exponential  smoothing 
produced  essentially  the  same  degree  of  accuracy  (+/- 12  items)  with  MSEs  of  143  and 
142  respectively. 


TABLE  3 


Comparison  of  Combined  H  &  N  Code  24-Month  Forecasts 
Excluding  Five  NSNs 


NSN 

Percent 

Percent 

Percent 

Percent 

Percent 

Percent 

Excluded 

Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

H3 

0.13 

0.11 

0.11 

0.11 

0.10 

0.06 

H6 

0.23 

0.22 

0.22 

0.21 

0.20 

0.15 

H9 

0.12 

0.12 

0.12 

0.13 

0.13 

0.11 

HIO 

0.06 

0.06 

0.05 

0.05 

0.05 

0.05 

M51 

0.30 

0.29 

0.29 

0.29 

0.29 

0.43 

Cumulative 

0.84 

0.80 

0.79 

0.79 

0.78 

0.80 

Revised  Avg. 
MSE 

142 

163 

162 

162 

162 

143 

Revised  Sq. 
Root 

11.91 

12.76 

12.72 

12.74 

12.74 

11.96 
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The  results  of  the  N-coded  only  demand  patterns  arc  provided  in  Table  4.  The 
lower  number  of  observations  for  the  N-coded  only  forecast  was  primarily  caused  by  a 
lack  of  N-coded  demand  for  several  on  the  sample  NSNs.  Furthermore,  SORTTEC  could 
not  compute  forecasts  fOT  4  NSNs  using  the  double  exponential  algorithm.  Additionally, 
AFSAC  forecasts  were  not  computed  for  four  NSN;; 


TABLE  4 

Comparison  of  N-coded  Only  24-Month  Forecasts 


Double 

Single 

Movir^ 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3 

Average  4 

Method 

MSE  Sum 

43042.12 

40002. 

■7  38578.29 

37672.94 

36645.88 

41537.12 

Observations 

51.00 

55.00 

55.00 

55.00 

55.00 

51.00 

Average  MSE 

843.96 

727.32 

701.42 

684.96 

666.29 

814.45 

Sq.  Root  MSE 

29.05 

26.97 

26.48 

26.17 

25.81 

28.54 

Unlike  the  combined  H  and  N-coded  forecasts,  the  four  period  moving  average 
produced  the  lowest  average  MSE.  The  AFSAC  and  double  exponential  methods 
respectively  had  the  highest  and  next  to  highest  average  MSE.  The  difference  between  the 
combined  H  and  N-coded  category  and  the  N-coded  only  category  forecast  is  caused  by  a 
different  demand  pattern  existing  for  the  N-coded  only  data. 

Again,  just  a  few  items  could  be  identified  as  contributing  the  major  pmtion  of  the 
overall  forecasting  error.  NSNs  H3,  H6,  H9,  HIO,  and  M51  comprised  between  84  to  93 
percent  of  the  total  forecast  error.  Table  5  shows  this  comparison.  After  the  five  most 
error  prone  demand  patterns  were  removed  from  the  average,  AFSAC  again  produced  the 
lowest  MSE.  NSN  M51  alone  produced  between  28  to  44  percent  of  the  error  in  the  N- 
coded  only  forecasts. 
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TABLES 

Comparison  of  N-codod  Only  24-Month  Forecasts 
Excluding  Five  NSNs 


NSN 

Percent 

Percent 

Percent 

Percent 

Percent 

Percent 

Excluded 

Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

H3 

0.11 

0.10 

0.11 

0.11 

0.11 

0.09 

H6 

0.30 

0.28 

0.28 

0.28 

0.27 

0.28 

H9 

0.09 

0.10 

0.11 

0.11 

0.12 

0.08 

HIO 

0.08 

0.08 

0.06 

0.06 

0.06 

0.05 

M51 

0.31 

0.28 

0.28 

0.28 

0.28 

0.44 

Cumulative 

0.90 

0.85 

0.84 

0.84 

0.84 

0.93 

Revised  Avg.  MSE 

94.73 

119.61 

121.17 

120.76 

120.83 

64.36 

Revised  Sq.  Root 

9.73 

10.94 

11.01 

10.99 

10.99 

8.02 

Thirty-six  Month  Forecasts 


The  results  firom  the  combined  H  and  N-coded  36  month  forecasts  are  listed  in 
Table  6.  SORTTEC  was  unable  to  produce  a  double  exponential  forecast  for  3  NSNs  and 
a  single  exponential  forecast  for  1  NSN.  In  this  forecasting  scenario,  the  four  period 
moving  average  produced  the  'best'  forecast  and  AFSAC's  formula  delivered  the  'worst' 
performance.  The  range  of  error,  measured  by  the  square  root  of  the  MSE,  was 
noticeably  larger  for  the  36  month  forecast  period  versus  the  24  month  forecast  period. 
The  36  month  error  ranges  from  +/-  31  items  for  the  'best'  to  +/-  37  items  for  the  'worst'. 


TABLE  6 

Comparison  of  Combined  H  ft  N  Code  36-Month  Forecasts 


Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

MSE  Sum 

66582.54 

64741.15 

63997.85 

62645.62 

60850.38 

88933.92 

Obsen/ations 

61.00 

63.00 

64.00 

64.00 

64.00 

64.00 

Average  MSE 

1091.52 

1027.64 

999.97 

978.84 

950.79 

1389.59 

Sq.  Root  MSE 

33.04 

32.06 

31.62 

31.29 

30.83 

37.28 

57 


With  the  large  error  caused  by  the  five  NSNs,  H3,  H6,  H9,  HIO  ,and  M51 
removed,  as  in  Table  7,  once  again  the  AFSAC  retention  formula  displayed  the  lowest 
MSE.  The  range  of  error  was  small;  trom  342  or  +/- 18  items  for  the  'best'  to  387  or  +/- 
20  items  for  the  'worst.' 


TABLE  7 

Comparison  of  Combined  H  &  N  Code  36-Month  Forecasts 
Exciuding  Five  NSNs 


NSN 

Percent 

Percent 

Percent 

Percent 

Percent 

Percent 

Excluded 

Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

H3 

0.07 

0.06 

0.07 

0.07 

0.07 

0.05 

H6 

0.16 

0.14 

0.13 

0.12 

0.11 

0.10 

H9 

0.11 

0.11 

0.11 

0.11 

0.11 

0.08 

HIO 

0.00 

0.05 

0.05 

0.05 

0.05 

0.04 

MSI 

0.34 

0.30 

0.29 

0.29 

0.28 

0.50 

Cumulative 

0.68 

0.67 

0.65 

0.64 

0.63 

0.77 

Revised  Avg.  MSE 

375.75 

363.56 

375.15 

381.16 

385.62 

341.96 

Revised  Sq.  Root 

19.38 

19.07 

19.37 

19.52 

19.64 

18.49 

The  results  of  the  N-coded  only  demand  patterns  are  provided  in  Table  8.  The 
lower  number  of  observations  for  the  N-coded  only  forecast  was  again  primarily  caused  by 
a  lack  of  N-coded  demand  for  several  on  the  NSNs.  Furthermore,  SORITEC  could  not 
compute  forecasts  for  2  NSNs  using  the  double  exponential  algorithm.  Additionally, 
AFSAC  forecasts  were  not  computed  for  4  NSNs. 


TABLES 

Comparison  of  N-coded  Only  36-Month  Forecasts 


Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

MSE  Sum 

57824.31 

51622.38 

50689.31 

49180.00 

47282.77 

88491.76 

Obsen/otions 

53.00 

55.00 

55.00 

55.00 

55.00 

51.00 

Average  MSE 

1091.02 

938.59 

921.62 

894.18 

859.69 

1735.13 

Sq.  Root  MSE 

33.03 

30.64 

30.36 

29.90 

29.32 

41.65 
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The  results  from  the  N-coded  only  36  month  forecast  was  similar  to  the  24  month 
forecasts.  All  of  the  moving  average  methods  out  performed  both  the  double  exponendal 
and  the  AFSAC  retention  formula.  The  four  period  moving  average  produced  the  lowest 
average  MSE.  The  AFSAC  and  double  exponential  methods  respectively  had  the  highest 
and  next  to  highest  average  MSE.  The  range  of  error  in  terms  of  items  ranged  from  -<-/-29 
items  as  the  ’best'  to  +/-42  items  as  the  'worst.'  The  difference  between  the  combined  H 
and  N-coded  forecast  and  the  N-coded  only  forecast  is  caused  by  a  different  demand 
pattern  existing  for  the  N-coded  only  data. 

Again,  just  a  few  items  could  be  identified  as  contributing  the  major  portion  of  the 
overall  forecasting  error.  NSNs  H3,  H6,  IK,  HIO,  and  M51  comprised  between  76  to  93 
percent  of  the  total  forecast  error.  NSN  M51  alone  produced  between  29  to  53  percent  of 
the  error  in  the  N-coded  only  forecasts.  Table  9  shows  this  comparison.  After  the  five 
most  error  prone  demand  patterns  were  removed  from  the  average,  AFSAC  again 
produced  the  lowest  MSE.  Here,  the  error  in  terms  of  items  ranged  from  +/-12  items  to 
+/-16  items. 


TABLE 9 

Comparison  of  N-coded  Only  36-Month  Forecasts 
Excluding  Five  NSNs 


NSN 

Percent 

Percent 

Percent 

Percent 

Percent 

Percent 

Excluded 

Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3 

Average  4 

Method 

H3 

0.04 

0.05 

0.06 

0.06 

0.07 

0.04 

H6 

0.24 

0.24 

0.23 

0.22 

0.21 

0.25 

H9 

o.n 

0.11 

0.12 

0.12 

0.13 

0.06 

HIO 

0.07 

0.07 

0.07 

0.07 

0.06 

0.04 

MSI 

0.33 

0.31 

0.30 

0.29 

0.29 

0.53 

Cumulative 

a79 

0.78 

0.77 

0.77 

0.76 

0.93 

Revised  Avg.  MSE 

254.43 

230.47 

232.57 

230.92 

228.28 

142.22 

Revised  Sq.  Root 

15.96 

15.18 

15.25 

15.20 

15.11 

11.93 
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Nine  Month  Forecasts 


The  results  from  the  H-coded  only  9  month  forecasts  are  listed  in  Table  10. 
SORTTEC  could  not  produce  a  double  exponential  forecast  for  7  NSNs  or  a  single 
expcHiential  fcvecast  for  1 NSN.  Addidonally,  13  NSNs  had  zero  H-coded  demands  over 
the  ten  year  sample  period.  In  this  forecasting  S(%nario,  the  four  period  moving  average 
produced  the  'best'  forecast  and  AFS  ACs  retention  formula  delivered  the  'worst' 
performance.  The  range  of  error,  measured  by  the  square  root  of  the  MSE,  was  relatively 
small  when  compared  to  the  error  the  36  month  and  24  month  forecasts.  The  9  month 
error  ranged  from  +/-  6  items  for  the  Tjest'  to  +/-  9  items  for  the  'worst'. 


TABLE  10 

Comparison  of  H-Coded  Only  9-Montti  Forecasts 


Double 

Single 

Moving 

Moving 

Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

MSE  Sum 

2393.91 

2093.86 

2117.27 

2006.50 

1854.36 

4040.09 

Observations 

42.00 

48.00 

49.00 

49.00 

49.00 

49.00 

Average  MSE 

57.00 

43.62 

43.21 

40.95 

37.84 

82.45 

Sq.  Root  MSE 

7.55 

6.60 

6.57 

6.40 

6.15 

9.08 

For  the  9  month  H-coded  only  forecast,  almost  half  the  error  for  the  traditional 
forecasting  methods  can  be  attributed  to  just  NSN  H3.  The  AFS  AC  retention  formula 
responded  much  better  to  this  demand  pattern  with  only  1 1  percent  of  the  MSE  error 
being  attributed  to  H3,  as  depicted  in  Table  1 1.  Unlite  the  24  and  36  month  forecasts, 
removal  of  the  error  caused  by  NSNs  H3,  H6,  H9,  HIO,  and  M51  did  not  change  the 
accuracy  ranking  of  the  methods.  The  four  period  moving  average  remained  the  'best'  and 
the  AFSAC  retention  fcmnula  performed  the  'wcnst'. 
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TABLE  11 

Comparison  of  H-coded  Only  9-Month  Forecasts 
Excluding  Five  NSNs 


MSN 

Percent 

Percent 

Percent 

Percent  Percent 

Percent 

Excluded 

Double 

Single 

Moving 

Moving  Moving 

AFSAC 

Exp. 

Exp. 

Average  2  Average  3  Average  4 

Method 

H3 

0.55 

0.47 

0.45 

0.45  0.43 

0.11 

H6 

0.00 

0.01 

0.01 

0.01  0.01 

0.00 

H9 

0.03 

0.05 

0.05 

0.06  0.06 

0.02 

HIO 

0.03 

0.04 

0.07 

0.07  0.07 

0.02 

M51 

0.06 

0.06 

0.05 

0.06  0.06 

0.01 

Cumulative 

0.67 

0.63 

0.64 

0.64  0.62 

0.16 

Revised  Avg.  MSE 

21.17 

18.12 

17.53 

16.63  15.95 

77.52 

Revised  Sq.  Root 

4.60 

4.26 

4.19 

4.08  3.99 

8.80 

Forecast  Error  Distribution 


In  order  to  measure  the  overall  the  degree  to  which  forecasting  methods  could 
accurately  predict  future  CLSSA  investment  item  demands,  an  analysis  of  the  results 
which  would  have  a  direct  effect  on  the  FMSO I  case  were  tabulated,  summed  and 
averaged.  This  produced  quantified  accuracy  measurements  for  Bve  forecasting  models. 
These  measurements  identify  which  model  forecasted  the  most  accurately  under  five 
different  categories  of  CLSSA  demand  scenarios.  The  scenarios  tested  were  1)  at  24 
months  using  ccnnbined  H  and  N  coded  demands  as  input,  2)  at  24  mtxiths  using  only  N- 
coded  demands,  3)  at  36  months  using  combined  H  and  N-coded  demands,  4)  at  36 
months  using  only  N-coded  demands,  5)  at  9  months  using  H-coded  only  demands.  Table 
12  presents  the  range  of  forecasting  enx)r  measured.  This  error  is  in  terms  of  the  square 
root  of  the  MSE.  The  square  root  of  the  MSE  reports  the  error  as  the  number  of  actual 
items.  Therefore,  the  average  error  over  the  five  CLSSA  demand  scenarios  equates  to  +/- 
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5.8  items  if  all  demand  patterns  are  included,  and  +/-  3  items  if  the  five  demand  patterns 
containing  spiked  demand  are  removed. 

As  evidenced  in  Table  12,  the  range  of  em>r  as  represented  by  the  difference 
between  the  'best'  and  the  'worst'  forecast  for  each  method.  Overall,  this  average  range  is 
not  great  in  terms  of  items.  From  this,  it  was  concluded  that  the  AFS  AC  retention 
formula's  accuracy  is  approximately  equal  to  that  of  the  other  forecasting  methods. 


TABLE  12 

Range  of  Error  Comparison  Among  All  Methods 


Method 

Low  Value 

High  Value 

Range 

24  Month  H&N  Combined 

26 

29 

3 

24  Month  Combined  (5  NSNs  Excluded) 

12 

13 

1 

24  Month  N-coded  Only 

25 

29 

4 

24  Month  N-coded  (5  NSNs  Excluded) 

8 

11 

3 

36  Month  H&N  Combined 

31 

37 

6 

36  Month  Combined  (5  NSNs  Excluded) 

18 

20 

2 

36  Month  N-coded  Only 

29 

42 

13 

36  Month  N-coded  (5  NSNs  excluded) 

12 

.  16 

4 

9  Month  H-coded  Only 

6 

9 

3 

9  Month  H-coded  (5  NSNs  excluded) 

4 

9 

5 

AVERAGE  RANGE  ALL  NSNs 

5.8 

AVERAGE  RANGE  (5  NSNs  EXCLUDED) 

3 

The  nx>st  relevant  categories  to  compare  accuracy  are  the  N-coded  24  and  36 
month  categories  and  the  9  month  H-coded  categories.  The  reason  these  are  considered 
to  be  the  most  relevant  categories  are  1)  the  new  CLSSA  program  uses  separate  H-coded 
and  N-coded  forecasts  to  compute  stocklevels,  therefore,  die  combined  categories  are  not 
relevant  measures,  and  2)  high  error  forecasts  cannot  sinqily  be  excluded  from 
consideration  in  actual  CLSSA  operation  as  was  done  for  this  research. 
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In  considering  only  the  relevant  categories,  the  four  period  moving  average  was 
the  most  accurate  in  each  category  with  an  average  error  of  +/-  20.43  items.  Table  13 
presents  these  results  with  a  comparison  to  the  AFSAC  retention  formula.  The  results  are 
significantly  higher  than  those  shown  in  Table  12;  however,  modifications  to  the 
forecasting  noodels  to  control  high  demand  spikes  would  greatly  improve  the  perfoimance 
of  either  model.  Although  the  improvement  in  accuracy  is  small,  these  results  lead  us  to 
conclude  that  the  four  period  moving  average  method  is  the  most  accurate  in  forecasting 
for  the  relevant  categories  of  the  sample  CLSS  A  data. 


TABLE  13 

Error  Comparison  in  Reievant  Categories  Only 
Method  4  Period  Moving  Avg.  AFSAC  Retention  Difference 


24  Month  N-coded  Only 

25.81 

28.54 

2.73 

36  Month  N-coded  Only 

29.32 

41.65 

12.33 

9  Month  H-coded  Only 

6.15 

9.08 

2.93 

AVERAGE  ERROR 

20.43 

26.42 

6.00 

Analysis  of  Results 

The  results  of  this  research  will  be  analyzed  relative  to  the  initial  investigative 
questions  and  to  the  degree  which  the  research  provided  the  necessary  information  to 
answer  them.  Each  investigative  question  is  repeated  below  with  a  discussion  of  the 
findings. 

1.  How  accurate  are  the  forecasting  methods  in  predicting  future  CLSSA  demands? 

This  research  measured  the  accuracy  of  each  forecasting  method  using  the  MSE  as 
the  measure  of  accuracy.  Tables  one  through  sixteen  present  these  accuracy 
measurements.  The  square  root  of  the  MSE  provides  a  better  estimate  of  accuracy  in 
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terms  of  number  of  units  error  from  the  actual  demand  On  average,  the  forecasting 
methods  predicted  actual  demands  to  with  +/-  5.8  items.  If  the  results  of  the  5  high  error 
generating  NSNs  are  removed  from  the  computation,  the  forecasting  methods  predicted 
actual  demands  to  within  +/•  3  items.  The  most  accurate  method  for  forecasting  in  the 
relevant  categcaies  (N-coded  only  at  24  &  36  months  and  H-coded  only  at  9  months)  was 
the  four  period  moving  average  method 

2.  To  what  extent,  if  any,  will  trends,  cycles,  and  seasonality  have  on  the  accuracy  of  the 
forecast? 

The  contribution  of  trends,  cycles  and  seasonality  was  discussed  in  detail  in  the 
discussion  concerning  the  classical  decomposition  model.  This  discussion  is  under  the 
heading,  "Forecasting  One  Lead-time  into  the  Future."  In  wOTking  with  the  data,  we 
found  diat  it  was  difficult  to  identify  a  true  trend  pattern.  Rather  than  trends,  the  data 
exhibited  random  patterns  of  spiking.  Attempts  to  use  a  trend  component  to  forecast  led 
to  large  forecasting  errors.  A  trend  line  was  computed  over  this  data  but  the  line  simply 
accommodated  factors  from  each  demand  period  rather  than  identifying  a  real  trend 
pattern.  Cycles  could  only  be  produced  from  judgmental  factors.  If  real  cycles  exist,  they 
are  caused  by  multiple  and  complex  factors  that  could  not  be  readily  identifred  and 
quantified  for  application  in  a  forecasting  model  Seasonal  factors  could  be  computed  and 
were  different  fra-  each  NSN.  The  seasonal  factca^  would  not  be  a  major  enhancement  in 
CLSSA  forecasting  due  to  the  forecasting  horizon  crossing  multiple  years.  In  summary, 
trend,  cycle  and  seasonal  factors  eitha*  could  not  be  used  or  did  not  improve  the  accuracy 
of  GLSSA  forecasts. 

3.  What  degree  of  improvement,  if  any,  is  achieved  by  each  of  the  four  forecasting 
methods  over  the  current  method? 


64 


Although  the  accuracy  exhibited  by  the  adaptive  filtering  and  decomposition 
models  were  extremely  accurate  in  foUowing  the  data  and  predicting  future  requirements 
one  quarter  into  the  future,  beyond  this  threshold  their  performance  went  to  negative 
fcnecasting  values.  These  models  attempted  to  force  a  cyclical,  seastHiality,  and  trend  to 
the  data.  Analysis  indicated  that  the  data  definitely  did  not  contain  identifiable  seasonality 
or  cyclical  patterns.  The  double  exponential  model  also  fell  short  in  its  ability  to  predict 
demands  for  all  of  the  NSNs  in  the  high  and  medium  demand  patterns.  The  double 
exponential,  even  with  zero  values  for  the  seven  NSNs  it  could  not  predict,  predicted  17.1 
percent  ($452,939)  more  dollars  and  26.3  percent  (309)  more  items  than  the  current 
method.  The  only  model  that  could  be  compared  on  a  one  for  one  basis  with  the  current 
method  was  the  AFSAC  retention  model.  The  AFSAC  retention  model  predicted  9.2 
percent  ($243,965)  more  dollars  worth  of  items,  however,  it  predicted  6  percent  (70)  less 
items.  See  Appendix  D  for  the  specific  details. 

4.  What  degree  of  improvement,  if  any,  is  achieved  by  the  three  traditional  forecasting 
methods  over  the  proposed  AFSAC  forecasting  method? 

Based  upon  the  various  forecasting  method  characteristics  identified  during  the 
literature  review,  we  initially  selected  to  measure  the  accuracy  of  the  double  exponential 
smoothing,  adaptive  response,  and  classical  decompontion  methods  in  relation  to  the 
accuracy  of  the  AFSAC  retention  formula.  As  previously  discussed,  both  the  adaptive 
response  method  and  the  classical  decomposition  method  were  eliminated  from 
OMisideration  early  in  the  research  process.  Only  the  double  exponential  method  remained 
firom  the  original  group  of  traditional  methods. 

For  the  24  month  forecast,  the  AFSAC  retention  formula  performed  the  best  of  all 
methods  tested  when  forecasting  for  the  combined  H  and  N-coded  demands.  However, 
this  measure  is  not  directly  relevant  to  the  planted  forecasting  implementation  of  the  new 
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CLSSA  process.  The  new  GLSSA  process  will  sq)arately  compute  an  H-coded  forecast 
and  a  N-coded  forecast  for  each  NSN  and  then  combine  them  to  establish  the  CLSSA 
stocklevel  for  the  NSN.  Therefore,  in  practical  terms,  the  N-coded  only  24  month 
forecast  is  of  greater  interest  In  this  forecast  the  AFS  AC  retention  formula  produced  a 
4.5  percent  more  accurate  forecast  than  the  double  exponential  method.  However,  the 
four  period  moving  average  produced  an  18  pocent  lower  MSE  than  the  AFS  AC 
retendon  formula.  After  the  large  error  attributable  to  5  of  the  64  NSNs  was  removed,  the 
AFSAC  formula  produced  the  lowest  MSE  which  was  33  percent  better  than  the  double 
exponential  smoothing  method  and  12  percent  better  than  the  foin*  period  nnoving  average. 

For  the  36  month  forecasts,  the  double  exponential  smoothing  method  produced 
more  accurate  forecasts  than  did  the  AFSAC  retention  formula.  Double  exponential 
smoothing  generated  an  MSE  that  was  21  percent  lower  for  the  combined  H  and  N-coded 
category  and  was  37  percent  lower  for  the  N-coded  only  category.  The  four  period 
moving  average  was  the  best  performer  in  both  of  these  demand  categories.  Compared  to 
the  AFSAC  retention  formula,  the  four  period  moving  average  produced  a  MSE  31.6 
percent  lower  for  the  combined  H  and  N-coded  category  and  49  percent  lower  for  the  N- 
coded  only  category  than  the  AFSAC  retention  formula. 

When  the  error  from  5  of  the  64  NSNs  was  removed  from  the  confutation,  the 
AFSAC  retention  formula  was  again  the  best  in  both  categories  (combined  and  N-coded 
only)  with  an  MSE  9  percent  and  44  percent  better  than  double  exponential  smoothing. 
The  AFSAC  method  was  also  1 1  percent  and  38  percent  better  than  the  four  period 
moving  average  in  both  categories. 

For  the  9  month  H-coded  only  forecasts,  the  double  exponential  snooothing 
method  produced  a  MSE  30  percent  lower  than  the  AFSAC  retention  formula.  When  the 
error  caused  by  5  of  the  64  NSNs  was  removed  from  the  computation,  the  difference 
between  double  exponential  smoothing  and  the  AFSAC  retention  fcxmula  was  even 
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greater.  With  the  revised  MSE,  double  exponential  smoothing  produced  a  72  percent 
lower  MSE  than  did  AFSACs  retendon  formula.  Excluding  the  error  from  the  5  NSNs 
greatly  reduced  the  MSE  for  double  exponential  smoothing  but  resulted  in  just  a  limited 
MSE  reduction  for  the  AI^AC  retention  ftvmula.  The  best  9  month  performer  was  the 
four  period  moving  average  which  produced  a  54  percent  lower  MSE  than  AFSACs 
retention  formula  when  forecasting  for  all  64  NSNs  and  generated  a  79  pocent  lower 
MSE  when  forecasting  with  the  5  high  error  NSNs  removed. 

5.  In  general,  will  forecasting  based  on  historical  demands  result  in  higher  or  lower 
quantities  of  CLSSA  reparable  requirements  compared  to  the  current  method? 

In  general,  the  forecasting  models  all  perfcmned  about  the  same  with  minor 
differences  in  the  quantities  predicted.  Each  model's  perforrrumce  improved  as  the  data 
patterns  matched  each  model's  characteristic.  The  AFS  AC  model  overall  seemed  to 
perform  the  best  over  the  data  patterns  tested  with  the  lowest  MSE  value.  However,  the 
double  exponential  would  not  compute  for  item  M22,  because  it  could  not  find  the  optimal 
alpha  value. 

Comparing  the  model  with  the  highest  MSE  (double  exponential)  and  the  lowest 
MSE  (AFS  AC)  with  the  current  method  resulted  in  an  overall  increase  in  the  quantity  of 
items  required  to  be  included  on  the  FMSO I  case.  However,  when  compared  to  the 
actual  demands  received,  the  current  method's  prediction  was  30  items  short  of  the 
requirement  in  the  high  demand  category,  and  367  items  over  the  requirement  in  the 
medium  and  low  demand  categories.  The  current  method  over  predicted  223  items  in  the 
medium  category  and  144  items  in  the  low  category.  Thus,  the  current  method's  forecast 
was  off  by  397  items  when  evaluated  against  the  customer's  actual  requirement  These 
c(»nparison  are  presented  in  Appendix  E. 
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The  AFSAC  nxxiers  peifoimance,  when  compared  to  actual  demands,  ova* 
predicted  the  requirement  in  the  high  and  medium  demand  categories  and  significantly 
under  predicted  the  requirement  in  the  low  demand  category.  The  amount  of  the  over 
prediction  was  234  items  in  the  high  category,  and  43  items  in  the  medium  category.  The 
under  prediction  equated  to  20  items  in  the  low  category.  Overall,  the  performance  of  the 
AFSAC  model,  when  compared  to  actual  demands,  resulted  in  a  diffoence  of  297  items. 

As  evidenced  by  the  data,  the  AFSAC  method  performed  better  than  the  current 
method  because  it  predicted  100  less  incorrect  items.  However,  if  the  AFSAC  model  is 
adjusted  to  round  down  for  items  with  a  forecasted  value  of  less  than  one,  the 
performance  of  the  AFSAC  model  is  improved  by  5.3  percent  or  16  items.  The  total 
number  of  incorrect  items  is  reduced  from  297  items  to  281  items  over  the  requiremenL 
Thus,  the  AFSAC  model  tends  to  be  a  better  choice  in  predicting  the  correct  items  to  be 
placed  on  the  stocklevel  case  than  the  current  method. 

6.  In  general,  will  the  amount  of  investment  funds  need  to  increase  to  support  the 
quarterly  CLSSA  reparable  requirements  predicted  by  the  forecasting  method? 

Because  a  direct  relationship  could  not  be  established  about  the  accuracy  of  a 
forecasting  method  based  on  the  cost  of  the  items  forecast,  the  data  was  evaluated  using 
three  different  methods.  The  frrst  method  was  to  calculate  an  average  cost  for  all  items 
within  the  sample  for  use  in  comparing  the  models.  This  was  calculated  by  taking  the  total 
cost  ($13,189,090)  of  the  sample  divided  by  the  total  quantity  of  4,722  demands  to  arrive 
at  an  average  value  per  item  of  $2,793.  This  average  value  was  then  assessed  to  the  total 
quantity  difference  among  the  models.  As  identified  in  the  Table  14,  the  lowest  dollar 
value  for  the  FMSO I  case  would  be  achieved  if  the  actual  requirements  could  be 
predicted  with  100  percent  accuracy.  The  next  best  model  in  both  dollar  value  and 
quantity  was  the  Air  Force  Security  Assistance  Center  Rounding  Down  (AFSACD) 


68 


model  where  the  forecasted  values  are  rounded  to  zero  for  values  less  than  one,  followed 
by  the  Air  Force  Security  Assistance  Center  Rounding  Up  (AFSACU)  model,  where 
forecasted  values  less  than  one  are  rounded  upwards  to  one.  The  current  method  resulted 
in  a  value  that  was  $941,241  higher  than  the  actual  demand.  If  this  is  a  representative 
sample  of  the  population,  and  this  error  relates  to  only  1.27  percent  of  the  population 
(136/10,696  NSNs),  then  by  extrapolation  the  ?>inount  of  error  in  the  total  population  of 
FMSO I  items  would  equate  to  $74,1 13,465  worth  of  items  being  held  in  the  absence  of  a 
demand.  As  expected,  from  its  higher  MSE  value,  the  double  exponential  was  the  worst 
perfcmner  predicting  $1,804,278  worth  of  additional  requirements  above  actual  demands. 
However,  these  results  are  based  on  taking  the  quantity  predicted  by  the  model  and 
multiplying  them  by  the  average  unit  pnce  of  $2,793,  and  should  not  by  themselves  be 
used  for  evaluation  purposes. 


TABLE  14 

Average  Value  Analysis  One 


Model 

Avg  Value 

Qty 

Actual 

$2.343327 

839 

Double 

$4,147605 

1485 

Current 

$3284368 

1176 

AFSACD 

$3,044370 

1090 

AFSACU 

$3,089X358 

1106 

The  second  analysis  conducted  was  to  calculate  and  average  cost  within  each 
category  to  determine  if  the  model  performs  better  based  on  certain  demand  patterns. 
Using  this  criteria  the  model  that  performs  best  in  the  low  category  is  the  AFSACU  model 
because  it  comes  closest  to  predicting  the  actual  quantity  demanded  by  only  10  items. 
Table  15.  Since  the  multiplier,  $1,462  (average  unit  price  per  category  of  items) 
evaluation  can  easily  be  accomplished  using  the  quantity  differential  by  itself.  However, 
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when  comparing  overall  model  performance,  the  significance  of  the  different  multipliers 
will  become  evident 

A  significant  point  to  recognize  in  the  low  demand  category  is  that  the  current 
method  predicts  a  value  400  percent  over  the  actual  requirement  Again  if  a  relationship 
between  items  and  cost  existed,  extrapolating  this  error  amount  into  the  total  population 
would  equate  to  $64,320,854  worth  of  incorrect  items  being  held  on  the  FMSO I  case. 

In  the  medium  category  the  best  performer  was  the  AFSACD  model,  followed  closely 
(within  6  items)  by  the  AFSACU  model.  The  difference  between  actual  demand  and 
AFSACD  model  is  approximately  20  percent  or  $82,907,  whereas  the  difference  between 
the  actual  demand  and  the  current  method  is  220  percent  or  $499,679.  In  iehlgh 
category,  the  current  method  is  the  better  performer  in  terms  of  predicting  the  number  of 
items  closest  to  the  actual  demand.  The  current  method  is  only  off  by  30  items,  however, 
it  is  off  in  the  negative  sense  by  not  predicting  enough  items.  The  current  method  was  the 
clear  winner  in  this  category  of  items  because,  we  submit  that  it  is  better  to  be  under  by  30 
items  or  $89,280  than  to  be  over  by  234  items  or  $696,384. 

In  an  overall  performance  rating  between  the  AFSACD  model  and  the  current 
method,  based  on  dollars  alone,  the  likely  choice  would  be  to  stay  with  the  current 
method.  However,  an  evaluation  based  on  the  total  number  of  items  correlated  to  the 
actual  requirement  would  lead  to  implementation  of  the  AFSACD  model.  This  difference 
is  a  direct  result  of  the  average  value  of  an  item  in  the  high  demand  category  being  large 
enough  to  offset  the  large  220  and  400  percent  errors  experienced  in  the  medium  and  low 
categories.  Thus  the  value  of  individual  items  that  reside  in  each  category  h^s  a  direct 
impact  on  the  decision  of  which  model  is  the  best  performer.  It  is  for  this  very  reason  that 
model  accuracy  was  based  on  the  actual  amount  of  deviation  the  predicted  value  was  from 
tte  actual  denumd  or  that  the  lowest  MSB  value  was  chosen  as  the  overall  measure  of 
model  performance. 
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TABLE  15 

Average  Value  By  Category,  Analysis  Two 


Total 

Total  High 

High 

Medium 

Medium 

Low 

Low 

Model 

Avg  Value 

Qty  Value 

Qty 

Value 

Qty 

Value 

Qty 

Actual 

$2287/410 

839  $1, 800/479 

605 

$416,772 

186 

$70,158 

48 

Double 

$3,793,508 

1485  $2,874,815  1052 

$918/i>92 

433 

N/A 

N/A 

Current . 

$2,908284 

1176  $1,711,199 

575 

$916451 

409 

$280,632 

192 

AFSACD 

$3X)37/468 

1090  $2496,863 

839 

$499/$79 

223 

$40,925 

28 

AFSACU 

$3J065529 

1106  $2496,863 

839 

$513,123 

229 

$55541 

38 

A  third  analysis  was  conducted  by  taking  the  average  cost  of  each  NSN 
requisitioned  over  the  ten  year  sample  period,  multiplying  it  by  the  acmal  demand  that 
occurred  in  the  quarter,  and  then  comparing  the  differences  in  the  NSN  demand  forecasted 
by  each  model.  The  purpose  of  this  analysis  was  to  simulate  the  actual  operation  of  the 
model- and  to  calculate  a  FMSO I  case  value  based  on  the  actual  NSNs  and  quantities 
forecasted  by  each  model  The  result  of  this  compariscxi  is  provided  in  Table  16.  The 
table  shows  that  there  is  a  disparity  not  only  in  the  number  of  items  predicted  in  the 
medium  demand  category,  but  also  in  the  mix  of  the  items  that  make  up  the  forecast  This 
is  evident  by  the  fact  that  the  actual  demand  for  223  items  costs  only  $529,286  yet  the 
actual  demand  for  the  forecast  period  was  a  different  mix  of  186  items  at  a  cost  of 
$565,389.  This  scenario  is  again  evident  in  the  total  value  column  where  the  actual 
demand  for  839  items  costs  more  than  the  forecasted  demand  for  the  current  method  and 
the  AFS  ACD  model.  Based  solely  on  the  total  dollar  value  column  the  best  method  is  the 
current  method  followed  by  the  AFSACD  method.  The  double  exponential  model  was 
excluded  because  values  for  the  low  demand  i^ms  were  not  calculated.  Again  making  an 
evaluation  solely  on  the  results  of  the  total  items  or  total  cost  of  the  model  is  not 
recommended  because  this  summary  chart  does  not  give  a  sense  of  the  number  of  times 
each  model's  forecast  differed,  along  with  its  magnitude,  from  the  acmal  demand 
experienced.  This  table  shows  that  if  the  models  perform  as  depicted  in  the  sample  then 
the  model  with  the  lowest  FMSO  I  value  would  be  achieved  using  the  current  method. 
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followed  by  the  AFS  ACD  model.  However,  experience  has  shown  that  the  cunent 
method  does  not  contain  the  right  mix  of  items.  Therefore,  it  is  a  question  of  whether  or 
not  it  is  worth  the  additional  $195,828  in  an  attempt  to  predict  the  right  items. 


TABLE  16 

Actual  NSN  Price  Comparison.  Analysis  Ihree 


Total 

Total  High 

High 

Medium  Medium 

Low 

Low 

Model 

Value 

Qty  Value 

Qty 

Value 

Qty 

Value 

Qty 

Actual 

$2,987,815 

839  $2,217B39 

605 

$565,389 

186 

$205287 

48 

Double 

$3,101,748 

1486  $2410,314  1052 

$691434 

433 

N/A 

N/A 

Current 

$2;648,809 

1176  $U81,375 

575 

$638,934 

409 

$328200  192 

AFSACD 

$2,844,637 

1090  $2,2334(43 

839 

$529286 

223 

$81,708 

28 

AFSACU 

$2,892,7/4 

1106  $2,233,643 

839 

$548442 

229 

$110289 

38 

Using  the  most  general  analysis,  analysis  one,  we  expect  the  value  of  the  FMSO I 
case  to  decrease  as  the  significantly  la^e  number  of  low  or  no  demand  items  are  removed 
from  the  case  and  replaced  with  items  that  have  an  active  demand.  Since  forecasting 
methods  were  only  concerned  with  the  accuracy  of  the  forecast  without  regard  to  the  price 
of  the  item,  we  should  be  able  to  infer  that  less  items  are  cheaper.  Therefore,  even  though 
it  seems  that  the  AFS  ACD  or  AFS  ACJU  model  will  over  predict  the  actual  demand,  it 
should  over  predict  by  a  lesser  amount  than  the  current  method.  And  since  items  equate 
to  dollars,  regardless  of  the  price  of  the  item  predicted,  less  ittms  predicted  should  mean 
less  dollars  required  for  improved  support 

Demand  Analysis 

An  additional  criteria  used  in  evaluating  forecasting  noodels  for  the  AFS  AC  was 
tiie  analysis  of  the  demands.  Table  17.  An  analysis  of  the  demands  and  the  percent  of 
dollar  values  in  each  category  indicates  that  AFSAC  should  select  a  model  that  performs 
best  in  the  high  and  medium  categories  because  85  percent  of  the  items  and  98  percent  of 
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die  dollars  are  in  the  high  and  medium  demand  category.  And  since  AFSAC  is  in  the 
business  of  selling  suppon,  a  model  that  excels  in  the  high  demand  category,  the  profit 
generators  would  be  more  advantageous  to  AFSAC  than  a  model  that  concentrates  on  the 
low  or  medium  demand  category.  In  the  research,  both  the  four  period  moving  average 
and  the  AFSAC  retention  performed  reasonably  well  in  the  high  demand  category.  This 
demand  analysis  also  substantiates  the  need  for  AFSAC  to  fine  tune  its  model  to  round 
down  for  items  with  a  forecasted  demand  less  than  one.  Adjusting  the  AFSAC  retention 
formula  to  round  down  would  eliminate  some  of  the  wasted  management  effon  in  trying 
to  control  the  plethora  of  low  demand  items  which  equate  to  only  2  percent  of  the  dollars. 

TABLE  17 


P«rc«nt  c4  Dollars  and  NSNs  by  Ccrtogoiy 


Number  of 

Percent 

NSNs  per 

Percent  of 

Demands 

Dollar  Value 

Doiiats 

Category 

Total  NSNs 

lto2 

$283,836.35 

2% 

35 

35% 

3  to  32 

$2.635 J079.20 

20% 

51 

52% 

33  to  210 

$10,270,174.64 

78% 

13 

13% 

Totals 

$13,189  J090.19 

100% 

99 

100% 

Summary  of  Results 


Accuracy  Comparison  -  The  range  of  forecast  error  as  represented  by  the 
difference  between  the  ’best  and  the  'worst'  forecast  for  each  method  is  not  great  in  terms 
of  actual  items.  The  overall  range  of  error  between  the  'best'  and  'worst'  methods  tested 
averaged  4-/-S.8  items.  With  the  large  error  values  attributable  to  5  specific  NSNs 
removed,  the  range  of  error  dropped  to  +/-  3  items.  These  results  lead  to  the  conclusion 
that,  as  a  whole,  all  of  the  forecasting  ttKxlels  examined  against  performed  with  an 
approximately  equal  amount  of  accuracy. 
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Financial  Impacts  -  In  addition  to  the  MSE  comparison,  dollar  value  and  the 
number  of  items  predicted  by  the  double  exponential  and  the  AFSAC  models  were 
compared  to  actual  demands,  to  historical  stocklevel  records,  and  to  the  stocklevel  dollar 
value  as  predicted  by  the  current  model  on  fourth  quarter  1991.  This  comparison  showed 
that  the  AFSAC  model  predicted  a  lower  dollar  value  FMSO I  investment  for  the  medium 
and  low  demand  category  of  items.  However,  fcv  the  high  demand  items,  the  ciurent 
method  of  letting  each  country  predict  their  demands  required  a  $785,663.90  lower 
FMSO  I  investment  ($1,71 1,199.77  versus  $  2,496,863.67)  than  did  the  AFSAC  model 
prediction.  Additionally,  the  current  method  resulted  in  a  greater  range  of  items  on  the 
stocklevel  case  (  839  versus  575,  a  difference  of  264  items)  than  did  the  AFSAC  modei. 
Considering  the  cumulative  impacts  in  the  low,  otedium  aiKl  high  demand  categories,  the 
AFSAC  model  required  a  $157,244.43  greater  FMSO  I  investment,  but  also  resulted  in  70 
less  NSNs  being  placed  on  the  stocklevel. 

COtegorv  Relevance  -  The  most  relevant  categories  to  compare  accuracy  are  the 
N-coded  24  and  36  month  categories  and  the  9  month  H-coded  categories.  The  reasons 
these  were  considered  to  be  the  most  relevant  measurement  categories  are  1)  the  new 
CLSS  A  program  will  use  separate  H-coded  and  N-coded  forecasts  to  compute 
stocklevels,  therefore,  the  combined  categories  are  not  relevant  measures,  and  2)  high 
error  forecasts  cannot  simply  be  excluded  from  consideration  in  actual  CLSSA  q}eration 
as  was  done  for  this  research. 

In  considering  only  the  relevant  demaixl  categories,  the  four  period  moving 
average  was  the  most  accurate  method  in  each  category.  Table  13  presented  these  results 
in  comparison  to  the  AFSAC  retention  formula  results.  Although  the  margin  of  improved 
accuracy  is  relatively  small,  the  four  quarter  nxjving  average  method  surpassed  the 
AFSAC  method  by  an  average  of  +/-  6  items  when  forecasting  for  the  relevant  categories 
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only.  Therefore,  of  the  methods  tested,  die  four  period  moving  average  method  is  the 
most  accurate  for  actual  CLSSA  investment  item  forecasting. 

Demand  Spiking  -  Demand  spiking  was  not  hypothesized  to  be  a  factor  influencing 
CLSSA  forecasting.  However,  demand  spiking  was  a  majOT  source  of  error  for  all  the 
mediods  tested.  For  this  reason,  separate  measurements  were  made  that  excluded  the  five 
most  dramadcally  impacted  NSNs.  These  five  NSNs  had  demand  patterns  dominated  by 
large  spikes  ranging  from  500  to  1 100  percent  of  average  demand.  Although  these  large 
errors  cannot  simply  be  ignored  when  actually  forecasting  for  CLSSA,  action  can  be  taken 
to  limit  their  influence  cm  the  forecasts.  If  action  is  not  taken  to  treat  these  demand  spikes, 
forecasting  models  will  predict  significantly  more  items  to  be  placed  on  the  stocklevel  than 
average  demands  actually  require.  Later  in  this  chapter  some  recommendations  are 
offered  for  treating  the  demand  spikes.  If  the  demand  spikes  can  be  effectively  treated, 
this  research  indicates  that  the  AFS  AC  retention  formula  would  produce  the  most 
accurate  results  for  the  N-coded  items; 

AFSAC  Retention  Formula  Weighting  Scheme  •  The  AFSAC  retention  model 
progressively  decreases  the  weight  of  older  demand  values  while  placing  greater  value  on 
the  most  recent  values.  No  benefit  was  found  by  weighting  demand  values  based  upon 
chronological  age  when  no  trend  exists.  The  only  advantage  provided  by  the  weighting 
scheme  is  that  it  progressively  reduces  the  influence  of  atypical  demands  as  they  become 
older.  The  key  element  in  making  accurate  forecasts  appears  to  relate  to  determining  the 
true  mean  demand  over  the  lead  time  period.  Rather  than  applying  decreasing  weights  to 
16  quarters  of  historic  demand  data,  the  true  mean  demand  coidd  be  approximated  more 
accurately  by  excluding  or  adjusting  atypical  quarterly  demands  so  that  they  do  not 
inappropriately  influence  the  average  lead  time  demand. 
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Inventory  Management  Principles  -  This  research  indicates  that  the  issue  of 
determining  an  appropriate  CLSSA  stocklevei  may  be  better  answered  using  traditional 
inventory  management  formulas  rather  than  forecasting  methods.  This  conclusion  stems 
firom  observing  that  the  'best'  forecast  performer  in  the  relevant  categories  (four  period 
moving  average)  singly  averaged  demand  over  the  lead  time  to  develop  a  forecast 
smckleveL  The  tradidonal  inventory  management  formulas  calculate  a  stocklevei  using 
the  average  demand  and  the  standard  deviadon  that  occurs  over  the  lead  dme.  In  addidon, 
the  inventory  management  approach  considers  the  average  lead  dme  and  the  standard 
deviadon  in  the  lead  dme.  Equipped  with  this  infoimadon,  managers  can  subjecdvely 
determine  the  level  of  support  to  be  provided  The  stocklevei  is  determined  by  compudng 
the  average  demand  over  the  lead  dme  and  then  adding  the  number  of  standard  deviadons 
of  lead  dme/demand  that  correspond  to  the  confidence  level  of  supptxt  desired.  A 
complete  presentadon  of  this  approach  to  stocklevei  calculadon  can  be  found  in  most 
inventory  management  texts. 
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Y,  Conclusions  and  Recommendations 


Conclusions 

This  research  focused  on  determining  if  an  auttxnated  forecasting  method  based  on 
historical  demands  could  accurately  predict  future  CLSS A  investment  item  demands. 
Based  upon  the  results  obtained  from  this  research,  implementadon  of  an  automated 
CLSSA  smcklevel  forecasting  model  is  warranted.  Automated  models  favor  having  the 
light  mix  of  items,  but  require  a  higher  level  of  customer  investment  cost  This  is  because 
automated  models  dynamically  respond  to  cusmmers'  actual  demand  patterns  in 
calculating  stocklevels.  As  a  consequence,  they  predict  higher  quantides  across  a 
narrower  range  of  recurring  demand  items.  The  current  manual  forecast  method  results  in 
a  lower  investment  cost  because  it  invests  in  lower  quanddes  across  a  broader  range  of 
items.  The  mix  of  materiel  forecast  by  the  current  manual  method  includes  many  items 
that  will  not  be  demanded.  An  automated  model  such  as  the  AFSAC  retendon  formula  is 
preferred  in  spite  of  the  higher  customer  investment  cost  because  an  automated 
forecasdng  process  better  supports  tlie  fundamental  purpose  of  CXSSA  which  is  to 
provide  timely  rectirring  logisdc  support  at  the  most  reasonable  cosl 

Considering  just  the  raw  data  with  its  demand  spikes,  the  four  period  moving 
average  model  produced  the  most  accurate  forecasts,  in  each  of  the  relevant  demand 
categories;  N-coded  only  at  24  months,  N-coded  only  at  36  mtmths  and  H-coded  only  at  9 
months  (see  Tables  4, 8,  and  10).  This  result  indicates  that  a  simple,  unweighted  moving 
average  forecasting  model  performs  bener  on  CLSSA  historical  data  than  does  the  more 
sophisticated  methods  of  exponendal  smoothing  or  the  AFSAC  retention  formula. 
However,  if  detruuid  spikes  are  controlled,  the  AFSAC  retention  formula  produced  the 
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most  accurate  results  in  the  relevant  categories  except  the  H>coded  only  at  9  months  (see 
Table  5, 9,  and  11). 

Recommendations 

The  following  additional  lecommendadcms  are  considered  important  to  further 
evaluate  the  results  and  to  extend  the  scope  of  this  thesis: 

1.  Addinonal  research  into  methods  that  fine  tune  the  AFSAC  model  u>  efiectively 
ccmtrol  the  influence  of  atypical  demand  patterns  (demand  spiking).  The  three  choices 
are:  1)  ignore  the  demand  patterns  and  treat  all  items  alike  (essentially  do  nothing),  2) 
develop  an  automated  program  to  cati:h  programmed  requisitimis  with  abnormally  high 
demands  (exceeding  a  specified  number  of  standard  deviations  frtm  the  mean)  and  have 
them  verified  prior  to  acceptance,  and  3)  treat  the  high  quantity  requisition  as  a  valid 
reciuring  demand,  but  then  have  SAMIS  increase  the  normal  stocklevel  value  by  a  portion 
of  the  spiked  demand  (increase  the  average  stocklevel  value  by  2  times  the  historical 
normal  demand).  Without  a  mechanism  to  control  these  data  patterns,  excessive 
quantities  will  be  procured.  This  divots  the  limited  financial  funds  fiom  the  actual 
recurring  requirements. 

2.  Further  analysis  into  the  performance  of  the  models  should  be  conducted.  The 
sample,  although  it  appeared  to  reflea  the  true  peculation,  may  contain  confounds  related 
to  the  particular  NSNs  selected,  which  may  have  corrupted  the  results.  A  different 
average  unit  price  mix  between  the  high,  medium,  and  low  demand  categories  would 
change  the  outcome  of  the  financial  analysis  comparison.  Testing  another  sample  of  136 
NSNs  is  recommended  to  determine  if  the  results  are  approxunaiely  the  same. 

3.  An  analysis  should  be  conducted  to  define  recurring  demand  in  relationship  to  a 
specific  time  fiame.  The  goal  of  the  CXSSA  program  is  to  provide  support  for  recurring 
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demands.  Demands  that  do  not  meet  the  definition  of  recurring  should  not  be  supponed 
with  a  CLSSA  stocklevel.  Once  this  is  clarified,  adjustments  to  the  AFSAC  model  could 
be  made  that  would  increase  the  accuracy  of  the  model. 

4.  If  an  automated  stocklevel  forecasting  model  is  not  implemented,  additional 
research  is  required  to  investigate  alternate  methods  to  control  the  large  number  of  item 
stock  numbers  placed  on  the  stocklevel  when  no  demands  are  ever  submitted  for  those 
items.  Almost  26  percent  of  the  stratified  random  sample  received  for  this  study  exhibited 
zero  demand. 

Summary 

Although  the  ideal  result  would  be  to  obtain  zero  forecasting  error,  an  automated 
forecasting  model  with  means  to  treat  demand  spikes  will  produce  an  acceptable  level  of 
accuracy.  Automated  forecasting  models  permit  efficient,  reasonably  accurate  quarteriy 
recalculation  of  all  CLSSA  investment  item  stocklevels.  Because  the  automated  models 
dynamically  respond  to  changes  in  item  demand  rates,  FMSO I  investment  funds  are 
constantly  reallocated  to  the  items  that  are  actually  being  demanded.  Equally  important  is 
the  fact  that  automated  models  quickly  react  to  items  that  have  no  demand  or  a  decreasing 
demand.  For  these  type  items,  these  models  automatically  reduce  the  stocklevel  in 
proportion  to  the  decrease  in  demand.  This  action  prevents  the  CLSSA  program  fiom 
procuring  materiel  that  no  customer  wiU  actually  demand  in  the  future.  Continuing  to 
carry  items  on  CLSSA  that  are  no  longer  required  is  a  financial  drain  for  both  the  CLSSA 
participant  and  for  the  USAF.  The  CLSSA  participant  has  its  S/17  FMSO  I  funds  invested 
in  the  items  it  does  not  require  when  the  funds  could  be  better  used  to  buy  the  items  for 
which  denuuids  actually  recur.  The  USAF  is  negatively  impacted  because  when  the 
material  is  delivered  to  the  US  depot  and  no  CLSSA  participant  has  ordered  the  items  on 
a  FMSO  n,  the  USAF  must  pay  the  12/17  of  die  materiel  value.  The  USAF  has  then  lost 
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the  use  of  this  12/17  value  for  an  undetermined  period  until  some  GLSSA  participant 
orders  the  item. 

An  automated  forecasting  model  also  simplifies  the  CXSS A  management  process. 
By  eliminating  the  complex  and  time  consuming  manual  forecasts  processes,  (XSSA 
participants  will  be  able  to  reallocate  their  supply  resources  K>  other  more  productive  uses. 
The  dynamic  nature  of  the  automated  forecasting  model  eliminates  the  need  u>  conduct  the 
semi-annual  CLSS  A  renegotiations.  Additionally,  as  customer  supply  personnel  turnover, 
the  learning  curve  related  to  CLSSA  management  for  new  personnel  will  be  greatly 
shortened. 

The  most  significant  result  of  transitioning  to  an  automated  investment  item 
forecasting  model  will  be  improved  customer  satisfaction.  CLSSA  participants  will  gain 
more  benefit  from  their  FMSO I  investment  l^th  the  FMSO I  funds  being  constantly 
applied  to  the  items  that  will  be  actually  demanded,  materiel  should  be  on  the  shelf  or 
already  on  order.  As  a  result,  requisition  fill-time  rates  for  CLSSA  investment  items 
should  improve.  As  CLSSA  FMS  customers  begin  to  receive  improved  performance  from 
CLSSA,  they  may  desire  to  have  more  of  their  weapon  systems  supported  via  the 
program.  Additionally,  as  current  non-CLSSA  FMS  customers  recognize  the  improved 
supply  service  available  under  CLSSA,  they  may  be  motivated  to  become  participants. 
CLSSA  by  definition  is  a  cooperative  program.  As  the  number  of  systems  and  customers 
being  supported  grows,  the  overall  service  to  each  individual  member  of  the  cooperative 
will  increase.  In  other  words,  a  synergism  develops  as  more  materiel  is  procured  under 
CLSSA. 

As  noted  earlier,  97  percent  of  all  requisitions  submitted  to  the  AFSAC  are  on 
FMSO  II  cases.  Efficient  and  timely  logistic  suj^n  via  the  USAFs  new  approach  to 
CLSSA  will  be  a  notable  factor  as  friendly  nations  of  the  world  consider  which  source  to 
acquire  their  next  major  weapon  systems.  The  US  has  long  maintained  a  reputation  for 
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reliable  and  effective  systems.  If  a  corresponding  strong  support  record  can  be  created  via 
the  new  approach  to  CLSSA,  the  US  as  a  whole  will  gain  from  the  political,  military  and 
ec(Hiomic  benefits  derived  from  additional  FMS  demand  for  US  weapon  systems. 
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Appendix  A:  Sample  National  Stock  Numbers 
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Randomly  Selected  List  of  136  NSNs 


1650000043744 

6610000458132 

2995000884182 

6685001159606 

6685001213348 

5998001225049 

2840001227122 

5895001368237 

1430001444407 

1560001641526 

2840001662356 

1650002230653 

6625002378870 

5841002491195 

5841002523500 

6115002560374 

5998002767505 

4820003131141 

1710003412064 

5821003464706 

2915003524767 

6130003617083 

5999003653101 

5826004040249 

6635004314371 

1560004335369 

1560004636767 

1650004910601 

1560004987867 

6620005049040 

5821005051336 

6625005286865 

5998012639415 

2840012965007 


4130010398991 

6625010400671 

6625010405961 

6625010405964 

2915010415660 

6625010429806 

5821010441810 

5998010492636 

5998010543961 

5999010575579 

6110010602407 

6615010633261 

7025010645128 

6150010651868 

2915010668842 

5998010687880 

5841010689152 

5999010704452 

5999010718430 

5821010759405 

5998010771457 

6625010776674 

5998010779343 

2915010783314 

5998010785540 

5998010804085 

6130010848525 

6110010860717 

4810010898900 

5998010902642 

5998010944089 

1270010993205 

3040012458158 

6130012481717 


5998009190024 

5821009290904 

2840009366719 

6620009898692 

6610009898886 

6625009957472 

5998009958756 

5998009970821 

7050010033121 

5895010052920 

5999010072882 

4810010074115 

1560010085288 

1650010101622 

4810010108472 

5998010110485 

7025010112968 

5998010122212 

6610010174787 

5998010270167 

6130010323966 

1660010365903 

6615010387297 

6110011464951 

2840011469378 

5826011626649 

6625011664206 

7025011681356 

2840011768601 

1005011909802 

2840011926911 

5841012090090 

5998012217228 

5895012314035 


6130013100808 

5998013292520 

1240997360412 

6150010993238 

6150011013073 

4920011023902 

6110011043082 

6340011047804 

6625011086601 

5998011113867 

4310011139363 

5841011158403 

1560011201934 

1280011260079 

1650011297553 

4320011316976 

5865011448567 

6625011464927 

5998005357643 

5999005396520 

6625006054563 

1650006136567 

3110006185880 

6105006608813 

1660006970846 

2915007062719 

5985007596990 

6105007914363 

1630008473731 

6720008508490 

2915008715870 

6110008732981 

1430009183652 

1560012355201 
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Thirty-Seven  Removed  NSNs 

NSN  Reason  For  Deletion 

1 56000 1 64 1 526  No  Demand  in  Ten  Year 

1650006136567  No  Demand  in  Ten  Year 
2840001227122  No  Demand  in  Ten  Year 
284001 1469378  No  Demand  in  Ten  Year 
2915003524767  No  Demand  in  Ten  Year 
2915010668842  No  Demand  in  Ten  Year 
432001 1 316976  No  Demand  in  Ten  Year 

5821010441810  Only  Demand  was  a  Drawdown 
58950 1 0052920  Only  Demand  was  a  Drawdown 

5998001225049  No  Demand  in  Ten  Year 

5998005357643  No  Demand  in  Ten  Year 

5998009958756  No  Demand  in  Ten  Year 

5998009970821  No  Demand  in  Ten  Year 
5998010779343  No  Demand  in  Ten  Year 
5998010785640  Only  Demand  was  a  Drawdown 
5998010944089  No  Demand  in  Ten  Year 
5998011113867  No  Demand  in  Ten  Year 
5999003653 101  No  Demand  In  Ten  Year 
5999010575579  No  Demand  in  Ten  Year 
5999010704452  No  Demand  in  Ten  Year 
5999010718430  No  Demand  in  Ten  Year 
6110010860717  No  Demand  in  Ten  Year 
5998013292520  No  Demand  in  Ten  Year 
6130012481717  No  Demand  in  Ten  Year 
613001 3 100808  No  Demand  in  Ten  Year 

6150010651868  No  Demand  in  Ten  Year 
6 1 500 1101 3073  No  Demand  in  Ten  Year 
6625002378870  No  Demand  in  Ten  Year 
6625006054563  Only  Demand  was  a  Drawdown 
6625010400671  No  Demand  in  Ten  Year 
6625010405964  Only  Demand  was  a  Drawdown 
6625010429806  Only  DemarKi  was  a  Drawdown 
6625010776674  No  Demand  In  Ten  Year 
662501 1464927  No  Demand  Ten  Year 
7025010112968  No  Demand  hi  Ten  Year 

7025010645128  No  Demand  in  Ten  Year 

7025011681356  No  Demand  in  Ten  Year 
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NSNs  Deleted,  Drawdown  Only  Demand 


NSN 

58210104418 

10 

Quantity 

1 

Dollar  Value 
964.20 

Julian  Date 
93312 

Disposition 

B 

58950100529 

20 

1 

4264.20 

90353 

B 

59980107855 

40 

2 

1317.37 

92197 

B 

66250060545 

63 

1 

1481.22 

92204 

B 

66250104298 

06 

1 

2414.68 

93007 

B 

66250107766 

74 

1 

4052.66 

86058 

A 

85 


NSN 


1660010365903 


Total  QtyiTotal  Volue  lAveroge  Voluel  Demands  i Cotego 


148!  1958096.761  13230.38 


6615010387297! 

80! 

388624.18 

1  4857.80! 

69IH2 

2995000884182 

846 

2467873.20 

i  2917.ni 

197IH3 

1270010993205i 

206 

476267.36 

1  2311.981 

172'H4 

63400110478041 

87 

186276.58 

2141.11 

44IH5 

1430001444407 

231 

92063.96 

398.55 

58iH6 

1560012355201 

248 

1176737.36 

4744.91 

116|H7 

5841002523500 

70 

1 130757.02' 

16153.67 

48iH8 

16500049106011 

374 

394743.27 

1055.46 

961h9 

3110006185880 

5331 

73725.77 

i  138.32 

92IH10 

16600069708461 

1091 

139023.88 

1275.45 

42IH11 

2915007062719 

3581 

1623515.71 

1  4534.96 

210IH12 

6610009898886 

1611 

162469.59 

1009.13 

105iH13 

Totals 


10270174.64 


7050010033121 

4 

1650000043744 

31 

1650010101622 

17 

4810010108472 

16 

6610010174787 

9 

5998010270167 

20 

6130010323966 

1  3 

i  Medium  Demands 


Total  QtyiTotal  Value  iAveroc 


2915010415660 


6610000458132 


6110010602407 


6615010633261 


5841010689152 


5821010759405 


59980108040851 


6130010848525 


4810010898900 


662501 1086601 


6685001159606 


6685001213348 


1280011260079 


1650011297553 


5895001368237 


586501 1448567 


58260116266491 


662501 1664206 


2840011768601 


1005011909802 


2698.12! 

674.53 

119190.77! 

3844.86 

32376.52; 

1904.50 

42038.41 

2627.40 

61353.39 

6817.04 

10798.63! 

539.93 

25657.38 


48772.521 


7161.57 


54042.75 


20561.27 


13918.66 


162369.05 


6925.46 


194396.90 


24474.88 


5018.841 


103390.72 


25678.91 


le  Value  Demands  i  Catec 


13IM2 


3 


5131.48 


1283.49 


1023.08 


857.82 


555.71 


4639.55 


2952.16 


1385.09 


10231.421 


1529.68 


1254.711 


8615.89 


2567.89 


m 


15IM4 


41 M5 


13IM6 


3IM7 


18381.08 

2625.87 

41 M9 

25063.29i 

696.20 

13IM10 

14894.66! 

3723.67* 

41M11 

9601. 56j 

1371.65i 

61M12 

3397.56! 

849.39 

3iM13 

6274.96! 

1254.991 

3IM14 

2629.04! 

1  328.63 

4IM15 

3 


29IM17 


M18 


241 M 19 


m 


3  M21 


5M23 


13  M24 


6IM25 


3IM26 


3  M27 


8IM28 


86 


2840011926911 


5841012090090 


59980122172281 


1650002230653 


58410024911951 


5998002767505 


2840012965007 


4820003131141 


1710003412064 


5821003464706 


1560004335369 


1560004636767 


5821005051336 


59990053965201 


6105006608813 


5985007596990 


6105007914363 


1630008473731 


61 10008732981 


1430009183652 


5998009190024 


2840009366719 


6620009898692 


Totals 


75760.87 


2098.13 


56952.751 


17420.46 


27904.20 


4904.41 


14136.891 


676.55 


45808.33 


1743.14 


142230.42 


1188.00! 


56616.63 


168549.44 


159650.18 


46444.12 


383232.061 


7366.36 


204318.29 


53511.10 


17753.96 


34128.08 


1176!  2635079.201 


15152.17 


2998.16 


5177.52 


1244.32 


2790.42 


700.63 


4712.30 


225.52 


5089.81 


52.82 


7055.76 


20318.63 


198.00 


11323.33 


1478.50 


14513.65 


636.22 


2425.52 


736.64 


5675.51 


4459.26 


106.31 


2437.72 


2240.71 


3IM29 


6IM30 


4iM31 


7IM32 


6  M33 


6iM34 


3  M35 


3 


5M37 


8 


3  M39 


6IM40 


3 


4IM42 


291 M43 


12  M49 


5  M50 


3  M51 


466 


NSN 


5999010072882 


4810010074115 


1560010085288 


59980101 10485 


5998010122212 


6625010405961 


5998010492636 


5998010543961 


5998010687880 


5998010771457 


2915010783314 


5998010902642 


6150010993238 


4920011023902 


6110011043082 


4310011139363 


5841011158403 


1560011201934 


6110011464951 


2840001662356 


Low  Demands 


Total  Qty  Total  Value  ] Average  Value!  Demands 


4296.291 


7597.28 


10869.95 


4563.04 


2559.99 


241.92 


5869.28 


1387.37 


2492.001 


5557.20 


7012.52 


8250.001 


13295.30 


41240.80 


964.21 


33797.50 


16235.05 


1828.48 


1075.41 


2148.15 


7597.28 


10869.95 


1293.60 


1 140.76 


2559.99 


241.92 


1956.43 


1387.37 


2492.00 


2778.60 


2337.51 


1650.00 


6647.65 


20620.40 


964.21 


6759.50 


8117.53 


1828.48 


51.21 


Coteoo 


35 


34 


L33 


L32 


L31 


L30 


L29 


L28 


L27 


L26 


L25 


L24 


L23 


L22 


L21 


L20 


L19 


L18 


87 


5895012314035 


3040012458158 


61 150025603741 


5998012639415 


6130003617083 


58260040402491 


6635004314371 


1560004987867 


6720008508490 


6620005049040 


6625005286865 


1240997360412 


2915008715870 


5821009290904 


6625009957472 


Totals  ! 


15700.00 


16876.01 


2069.63 


2176.281 


413.78 


819.121 


1700.60! 


3300.00 


1461.58 


2220.68 


1186.62 


33840.44 


6441.20 


637.361 


20685.06 


283836.351 


15700.00 


3375.20 


1034.82 


2176.28 


206.89 


273.04 


850.30 


1650.00 


730.79 


555.17 


1 186.62 


16920.22 


3220.60 


637.36 


6895.02 


1461.63 


2IL13 


1IL12 


2IL3 


11L2 


2IL1 
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Appendix  B:  Data  Patterns 
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Damands  6  Demands 


H3 


e5.  Demand  Pattern  for  Item  H3 


H4 


Figured.  Demand  Pattern  for  Item  H4 


91 


Demands 


Figures.  Demand  Pattern  for  Item  H6 
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Demands  B  Demands 


H7 


e9.  Demand  Pattern  for  Item  H7 


H8 


Figure  10.  Demand  Pattern  for  Item  H8 
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D«muids  E  Demands 


60 


c  1 1.  Demand  Pattern  for  Item  H9 


HIO 


Figure  12.  Demand  Pattern  for  Item  HIO 


‘>4 


Damands 


r-  CO  »o  h.» 
CM  CM  c\d  N 


m  o> 

CO  fO  fO 


^colA^»ok«-(Oinr^Ol 


Rj  n  S 


Quarter 


Figure  13.  Demand  Patter  for  Item  HI  1 


H12 


Quarter 

Figure  14.  Demand  Pattern  for  Item  H12 


95 


«  *o  t*. 


^CMCMCMCviNmmnnn 

Quchtt 


Figure  15.  Demand  Panem  for  Item  Hi3 
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D«in«nds  S  Demuida 


Medium  Combined  Demand  Patterns; 


Ml 


10 
9 
8 
7 
6 
5  ■■ 
4 

3  • 
2 
1 

0 


A 


Ok  ^ 

Ouorlir 


» 

OJ 


CM 


Ok 

CM  CO 


CO 

CO 


Ilk 

CO 


CO 


o> 

CO 


e  16.  Demand  Pattern  for  Item  Ml 


M2 


97 


Demands  E  Demands 


M3 


e  18.  Demand  Pattern  for  Item  M3 


Mi 


10  T 
9  • 
8  ■ 
7  ■ 
6  • 
5  ■ 
4  ■ 
3  ■ 
2  ■ 
1 


. . A . . .  ■  /,\ 


^ninr^ai<-rain 


?  ^  !3  »  IS 
Ouortsr 


n  S  $  m  S 


Figure  19.  Demand  Pattern  for  Item  M4 
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Demands  E  Demands 


MS 


e20.  Demand  Pattern  for  Item  M5 


M6 


Figure  21.  Demand  Pattern  for  Item  M6 


99 


Demands 


M7 


10  ■ 

9 

8  ■ 

7  ■ 

6 

5  •• 

4  ■ 

3  ■ 

2 

1  ■ 

0 . .  . 

OuahM 


Rgure22.  Demand  Pattern  for  Item  M7 


MS 


Hgure23.  Demand  Pattern  for  Item  M8 


100 


Demands  s  Demands 


m 


Qucrter 


e  24.  Demand  Pattern  for  Item  M9  ^ 


M10 


Hgure25.  Demand  Pattern  for  Item  MIO 


101 


Demands 


Mil 


o>  •-  «  in 


01  r;  «  w  h. 
^  ni  CM  CU  (M 


a  m 

Ki  n  n 


Qucrtor 


Figure  26.  Denuuid  Patter  for  Item  Ml  1 


M12 


10 


I 


9 

8 

7 

6 

5 

4 

3 

2 

1 

0 


^  CO  lA 


0»  ^  CO  (A 


Quarter 


Hgure27.  Demand  Patterns  for  Item  M12 


102 


Oeinands  §  Demands 


M13 


e28.  Demand  Patterns  for  Item  M 13 


M14 


Hguie29.  Demand  Patterns  for  Item  M14 


103 


10  ■ 


■o 

S 

s 

2 


Figure  31.  Demand  Panems  for  Item  Ml 6 


?  Si  13  » 

Quortar 


104 


Demands  G  Demands 


M17 


e32.  Demand  Patterns  for  Item  M 17 


M18 


105 


Demands 


V 


M19 


Ouortw 

Figure  34.  Demand  Patterns  for  Item  Ml 9 


Ckntar 

Figure  35.  Demand  Patterns  for  Item  M20 


106 


0«inands  §  Demands 


M21 


e36.  Demand  Patterns  for  Item  M2 1 


M22 


10  T 


9 

8 

7 

6 

5 

4 

3 

2 

1 

0 


vi _ Cv 


Qucrtar 


Figure  37.  Demand  Patterns  for  Item  M22 


107 


Demands  §  Demands 


M23 


;38.  Demand  Patterns  for  Item  M23 


M24 


Quarter 

Figure  39.  Demand  Patterns  for  Item  M24 
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Demands  §  Demands 


M25 


M26 


Qucrtw 


Figure  41.  Demand  Patterns  for  Item  M26 


109 


M27 


10 

9 

8 

7 


Quorter 

Rgure42.  Demand  Patterns  for  Item  M27 


M28 


110 


Demands  g  Demands 


M29 


M30 


Hg;ure4S.  Demand  Patterns  for  Item  M30 


111 


Demands  §  Demands 


Figured?.  Demand  Patterns  for  Item  M32 


112 


Oemands 


n  in 


cn1-mln^■a>v-coln^•Q>•-e9lnroa> 

Qucrter 


Figure  48.  Demand  Patterns  for  Item  M33 


10 

9 

8 

7 

6 

5 

4 


3t 


1 


/:wA 


i>-minr^a>«-«oinh>o>i-mini'>p>T-minr>~a> 

Quortor 


Figuie49.  Demand  Patterns  for  Item  M34 
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DemuMls  §  Demands 


MSS 


10  T 
9 
8 
7 
6 
6 
4 
3 
2 

1  ■■ 
0 


»-  «  u>  CB  •- 


m  «o  <»  ^ 
^  ^  ei 


«  «ft 
Kl  CM  <M 


S  m 


Qucrter 


sSO.  Demand  Panems  for  Item  M35 


MSS 


HgureSl.  Demand  Patterns  for  Item  M36 


114 


Denuuids  §  Demands 


M37 


^/Q8 


Figure  53.  Demand  Panems  for  Item  M38 


115 


spucuieQ  5  •pOTui*o 


:54.  Demand  Patterns  for  Item  M39 


M40 


HgureSS.  Demand  Patterns  for  Item  M40 


116 


M41 


10 

9 

8 

7 


Quchut 


Figure  56.  Demand  Patterns  for  Item  M41 


M42 


Figure  57.  Demand  Panems  for  Item  M42 
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Demand*  §  Demands 


M43 


M44 


Figuie59.  Demand  Patterns  for  Item  M44 


118 


M45 


Figure  60.  Demand  Patterns  for  Item  M45 


M46 


Hgiiie61.  Demand  Patterns  for  Item  M46 


119 


M47 


Hgure  62.  Demand  Patterns  for  Item  M47 


M48 


120 


Damands  E  Demands 


M49 


Qucrtor 


64.  Demand  Patterns  for  Item  M49 


MSO 


140  j 


Quartsr 


Figure  65.  Demand  Panems  for  Item  M50 


121 


M51 


Figure  66.  Demand  Pattern  for  Item  5 1 
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Appendix  C:  Data  Inputs 
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Sample  of  Data  Input  Format  for 
One  Quarter  Into  the  Future  Forecasts 


Quarter 

Combined 

H-coded 

N-coded 

1 

8 

7 

1 

2 

9 

0 

9 

3 

5 

4 

1 

4 

6 

2 

4 

5 

5 

5 

0 

6 

7 

5 

2 

7 

4 

4 

0 

8 

3 

1 

2 

9 

2 

1 

1 

10 

5 

5 

0 

11 

8 

2 

6 

12 

0 

0 

0 

13 

2 

0 

2 

14 

3 

3 

0 

15 

0 

0 

0 

16 

7 

5 

2 

17 

1 

1 

0 

18 

1 

1 

0 

19 

2 

2 

0 

20 

2 

2 

0 

21 

1 

0 

1 

22 

4 

2 

2 

23 

2 

2 

0 

24 

2 

2 

0 

25 

3 

0 

3 

26 

2 

1 

1 

27 

2 

2 

0 

28 

1 

1 

0 

29 

5 

4 

1 

30 

2 

2 

0 

31 

4 

4 

0 

32 

5 

0 

5 

33 

1 

1 

0 

34 

0 

0 

0 

35 

3 

2 

1 

36 

0 

0 

0 

37 

8 

7 

1 

38 

5 

4 

1 

39 

7 

7 

0 

40 

11 

2 

9 
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Sample  of  Data  Input  Format  for 
24  Month  Forecasts 


Combination 

H-coded 

N-coded 

47 

28 

19 

41 

22 

19 

37 

27 

10 

40 

25 

15 

34 

23 

11 

31 

18 

13 

27 

16 

11 

23 

12 

11 

27 

16 

11 

26 

16 

10 

22 

12 

10 

16 

12 

4 

18 

14 

4 

17 

14 

3 

18 

13 

5 

20 

15 

5 

15 

12 

3 

17 

11 

6 

18 

11 

7 

18 

11 

7 

17 

10 
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36 

26 

56 

29 

27 

50 

32 

18 

45 

28 

17 

46 

31 

15 

42 

27 

15 

36 
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13 

34 

21 

13 

33 

22 

11 

32 

21 

11 

31 

18 

13 
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18 

7 

27 

20 

7 

28 

20 

8 

27 

18 

9 

29 

20 

9 

23 

16 

7 

27 

19 

8 

28 
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30 

22 
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33 

20 

13 

33 

21 

12 

29 

19 

10 

30 

19 

11 

28 

17 

11 

33 

24 

9 

36 

27 
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51 

33 

18 
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3 
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2 
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23 

6 

0 

3 
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24 

10 
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3 
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19 
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7 

10 
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17 
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5 
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28 
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21 
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28 
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25 
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17 
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M17  1283.49  1  11  4  «  4  1283.49  5133.96  6133.96  14118.39  2  2566.98 

M18  1023.08  4  1  2  2  2  4092.32  2P46.16  2046.16  1023.08  3  3069.24 

M19  867.82  6  6  7  7  7  5146.92  6004.74  6004.74  6146.92  10  8578.20 

M20  655.71  12  0  7  7  7  6668.52  3889.97  3889.97  0.00  6  3334.26 

M21  4639.56  0  2  2  2  2  0.00  9279.10  9279.10  9279.10  2  9279.10 
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LI  10342.63  2  1  10342.63  0  0  0  0.00  0.00  20686.06 

Total  48  192  382600.62  32.4048  28  38  81708.28  110689.13  206387.84 
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